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The halftone system of HUMRRO, rumored on 
Pp. DM38, is real. Clever indeed: it divides the 
half-tone problem into two parts, one the orig- 
inal picturing of the scene, the other its pres- 
entation in the terminal. That means that their 
system permits one central image generator to 
send out pictures to as many terminals as de- 
sired. Unlike the Watkins Box (see p. DM37), 
whose half-million-dollar opulence can be poured 
only on a single user at once, in this system 
the central resource can be distributed among 
various users, with each one's picture changed 
intermittently, or poured on a single user for 
full animation. Currently it runs in Fortran, 
transmitting encoded pictures to the unusual ter- 
Minals required (built around Trinitrons). But 
a special central processor is foreseen. 

The system is called CHARGE, and Ron Swallow, 
its developer, is indeed a hard charger. (Soft- 
ware: Bill Underhill and Roger Gunwaldsen.) 
Swallow's game isn't movies or engineering gra- 
phics; he wants CHARGE to compete head-to-head 
with PLATO (see pp. DM26-7). And at the prices 
he's talking about-- $5000 per terminal and 
$150,000 for the central processor-- who knows? 


UNREAL ESTATE: for relaxation, Ron works on 
the "dream house" he keeps inside the system. 
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Video t oe 
Yuen, TURN , TURN 

Since the forties, there have been continual 
announcements that video disks-- movies you play 
on your TV off a record-- were right around the 
corner. Earlier this year they were supposedly 
going to be available before Christmas. Now they 
might be on sale, "on a limited basis," in 1976. 
(TV Guide, 16 Aug 75, p. 7.) Because of the grave 
difficulties of engineering-- inaccuracies in pun- 
ching the center hole mean the track can't help 
being off center, for instance-- some of us are 
skeptical. 

Two systems have been confidently announced. 
Philips, the firm that gave us the audio cassette, 
has a system that will follow the spiral track on 
the disk from underneath with a laser. The disk 
turns at 30 revolutions per second, or one turn 
per TV frame, so it can supposedly freeze on one 
frame when desired. 

The other system is from RCA, which has 
a long history of me-too announcements, but at 
least two of them made it big (the 45 record and 
the color TV system now used in the USA), so RCA 
should not be dismissed out of hand. Their disk 
system will supposedly go at 450 rpm (7.5 revol- 
utions/second), but they still mean to track it 
with a needle. The man from TV Guide says he's 
seen it and it works perfectly, but I would per- 
sonally look for hidden wires. 

(MCA, an entertainment conglomerate, has 
hitched up with Philips and printed a catalog of 
all the movies they will supposedly make available 
on disk for the "MCA-Philips" system-- such as 
Destry Rides Again for around ten bucks. This is 
probably just a bluff; with the price of audio 
records what they are, no way is a movie going to 
cost ten bucks. But it makes RCA look weaker, 
which is probably the purpose.) 


Movies FROM Your ChpuTER 


The prospect surprised them, but MAGI (see 
p- DM36) allows as how they might let you make 
movies on their over-the-phone movie-making setup 
(sketched on p. DM36). Price to capable out- 
ders, if the software meshed, would be about $50 
an hour. (Six hours makes one minute of film, 
not counting the phone bill. Cheap if you know 
movie economics.) 

Meanwhile, John Lowry, at Digital Video Lab- 
oratories in Toronto, has been developing high- 
quality video suitable for transfer to theatrical 
film. He and they have developed a 655-line 
color system-- with heavy digital enhancement 
(see "Picture Processing," p. DM10). I scarcely 
believe my notes, but I saw it, and wrote down 
‘that it was comparable to 35mm studio color. 


The day of “electronic cameras"-- that is, film- 
quality video-- may be upon us soon. 
ort <S 


About 1972, there was announced an electron- 
ically-controlled color filter that could change 
to any hue in nanoseconds. That would be just 
what we all need for color movies from COMs-- 
but what happened to it? 


TT Tre s,s | 


Millions of people saw computer graphics for 
the first time on the PBS "Ascent of Man" series, 
where a screen drawing of Early Man's skull was 
seen to rotate and gradually change in its fea- 
tures. This was startling even if you know about 
computer graphics, since it seemed to be proceed- 
ing from complex data concerning the entire 
skulls and their changes. 

Not so. Actually what you saw was a series 
of skull drawings by Peter Foldes, a Parisian 
artist, with the computer generating transitional 
drawings between them. (Indeed, though you saw 
Prof. Bronowski next to the screen, you did not 
see him next to the screen at the same time the 
drawings were changing-- because that had to be 
filmed very slowly.) 

The system was created by Nestor Burtnyk and 
Marcelli Wein, of the National Research Council 
of Canada. It currently runs only on an SEL 840A. 
(It was also used by the National Film Board of 
Canada for creating Foldes' splendid film "Hun- 
ger.") They can preview by rolling through bit- 
map video on a moving-head disk. (See Burtnyk 
and Wein, "Computer Generated Key-Frame Anima- 
tion," J. SMPTE, March 71, 149-53.) 


What about the animated figure that talks to 
Joe Gariagiola before baseball games? Haha. 
That's a rubber puppet matted in from a black box; 
the guy who does the voice works the mouth. 


Many unltkely tndividuals have stormed that 
heartbreak town of Hollywood, leaving sadder but 
wiser-- but Ivan Sutherland, dean of computer 
graphics? Well, having found that the movte- 
makers are not ready for image synthests-- the 
dreamsmiths unprepared, as it were, for the Total 
Forge-- he ts sojourning at the Rand Corporation. 


A fella named Charles McCarthy, of suburban 
Chicago, bought the "Computer Eye" from Spatial 
Data Systems, and will do mail-order picture con- 
versions. He'll convert your favorite snapshot 
to a printout of the same subject made of light 
and dark letters. If you're interested in having 
the actual grey-scale data for processing in your 
own computer, inquire. 

The Mobius Group, Inc., P.O. Box 306, Win- 
field IL 60190. 


Want a computer-controlled videocassette 
recorder? The model to ask for is the Sony 2850, 
costing (gasp) some six thousand bucks. An in- 
terface to the PDP-11 is made by CMX Systems, 

635 Vaqueros, Ave., Sunnyvale CA 94086. 

Incidentally, scaled-down CMX editing setups 
are beginning to get around. For instance, they 
have a small setup in the pleasant offices of DJM 
Film & Tape, 4 East 46, NYC: three of the above 
Sonys and the CMX Model 50 control setup, using 
a PDP-11 and keyscope. Though prices are by the 
job, the basic charge is $75/hour. (Note that 
the big CMX setup, with a disk, is the model 300.) 


VECTOR DISPLAYS 


At the high end of things, a firm called 
Three Rivers Company has come in with a 3D vec- 
toring system (competitors discussed p. DM30). 
Supposedly they can pack a lot more lines on the 
screen. 

The price of the GT40 display (see p. DM21), 
which all in all is one of the best displays on 
the market, has just dropped to $6500. To dis- 
guise this pri¢e drop, DEC gives you the smaller 
tube and no keyboard. 

And at the low end, a firm called Megatek 
in San Diego offers line-drawing CRT controllers 
for $1000 to $3000. All permit animation. You 
have to supply the oscilloscope. Their equipment 
plugs into the PDP-11 or the Nova, or in one 
case connects in tandem to an ASCII time-sharing 
terminal (!). 

The 11 and Nova models work directly from 
BASIC; your program in Basic puts line lists in 
the device's buffer memory. The time-sharing 
model converts incoming line lists from ASCII to 
binary and stores them internally. 256 lines 
with 8-bit resolution cost $1900, $110 and $1600 
for 11, Nova and t-s respectively; 1024 lines 
with 10-bit resolution cost $2800, $2000 and 
$2500 respectively. (Nova and 11 models can be 
completely updated in two refresh cycles, yiel- 
ding as much animation as anyone can decently 
expect for the price. Software is supplied to 
provide display output from Nova, PDP-11l or time- 
sharing BASIC; also t-s Fortran.) 

Meanwhile, for the hands-on electronics guy, 
Optical Electronics, Inc. makes all kinds of ro- 
tation modules. You can build your own 3D rota- 
tion setup out of their modules for a couple of 
thousand; but, of course, the fancy digital I/O 
for high-speed refreshment is not available. 

An interesting capability of the OEI equipment, 
though, is that you can build 4D- or even 5D- 
rotation systems out of their modules. Hmmm. 
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PLATO news 


Excellent manuals on the PLATO system and 
TUTOR language are now available from CERL, Uni- 
versity of Illinois, Urbana. 

The next generation of PLATO terminals is 
coming down the line. The microfiche projector 
is withering away, as was easily foreseeable; 
meantime, steps are being taken toward a more 
high-performance terminal, by putting a computer 
in it. This is being done both by Jack Stifle, 
who has done it with the Intel chip, and Roger 
Johnson, who has the panel interfaced to an ll. 
(11 fans please note the implication: it is pos- 
sible that the interface may be marketed.) 

Meanwhile, PLATO-like terminals (the model 
AG-60) are about $5000 from Applications Group, 
Inc., P.O. Box 444B, Maumee, Ohio 43537. Note 


‘ that these have standard non-PLATO interfaces 


and standard keyboards, but the Owens-Illinois 
plasma panel (erroneously called Corning else- 
where in the book) blazes in all its glory. 


Bir Wes 


The main development in computer graphics in 
the last year has been the sudden upsurge of the 
bit-map approach to computer display. While the 
approach, and equipment for it-- like the Data 
Disk system-- have been around for some time, the 
falling price of electronics, especially in the 
Memory area, have made it abruptly the cheapest 
and thus the most popular type of computer dis- 
play for graphics. 

A "bit map" is a series of dot positions, 
or bits, recorded in some form of fast memory 
and read out in sync to a conventional scanned 
video system (see pp. DM6-7). The one bits 
stand for dots or little squares, the zeroes 
for nothing, and the video system brightens the 
corresponding zones on the screen. This method 
has certain disadvantages-- parts of pictures 
cannot be automatically distinguished or sepa- 
rately animated, as with subroutining display 
(see "The Mind's Eye," esp. p. DM23)-- but for 
the money it's great. Sizes given refer to the 
number of squares in the rectangle of the picture. 


BLACK-AND-WHITE 


An off-the-shelf bit-map system for the 
PDP-11 or the Nova is available from Intermedia 
Systems, 20430 Town Center Lane, Cupertino CA 
95014 ($2750 or $2500 respectively). May be 
ganged for grey-scale or color. It's 256x256. 

For the Altair, the forthcoming 8096 display 
(see p. Y) will have 120x120 or 240x240 bit-map 
graphics, for prices starting around $1000. 


COLOR 


Extra bit maps, plus electronics, can get you 
color; if you double the number of bits you can 
double the number of available colors on your dis- 
play, ad infinitum. 

On the small side, 64x64 color wll shortly 
be available for the Altair from the Digital Group, 
Denver. A 128x128 color bit-map system for the 1l 
has just been announced by DEC (for "nuclear medi- 
cine" of all things-- but they will part with it 
to anybody for 8 or 10 thousand (not yet fixed)). 
they stress that this will be the first of a modu- 
lar series of bit-map displays, with plugins for 
different degrees of resolution and different 
character generators. 

Ramtek and Comtal both make 256x256 bit-map 
systems, priced in the $16,000 area. 

Above this resolution special TV systems tend 
to be necessary. Both Ramtek and Comtal make very 
expensive systems for the purpose, using 
solid-state and disk respectively. 

You may or may not have heard of the Advent 
TV projector, the most glorious TV thing there is. 
It costs $3500 and projects a four-foot picture in 
the best TV color you can find. A lot of guys are 
bit-mapping to it. 

At MIT they've got bit-map color on the Ad- 
vent at better than 400x500 resolution. (An option 
planned for the Flying Turtle (see p. Y) will al- 
low its core memory to be used with the Advent as 
a bit-map display refresher.) At Comtal they're 
going for 1000x1000 on the Advent, rejiggering the 
electronics from scratch. 

The most spectacular demonstration of bit-map 
color so far has no doubt been the film done by 
Dick Shoup et al. at Xerox PARC (see p. X), show- 
ing the super animation that's possible when big- 
computer resources are given over to bit-map ani- 
mation. Their system is 600x800. 


—e 


Your, Bic DISPEAY PaNecs 


All those scoreboards and wisecracking light- 
grids, now that they are computer-controlled, 
raise all kinds of possibilities for non-frame 
animation. The big ones cost in the millions; a 
small one for shopping centers costs a hundred 
grand (Millenium Info Systems, Santa Clara CA). 

Within a year or so, though, you ought to 
be able to get a nice animated display-panel of 
some sort for the side of your van, assuming 
you've got the computer inside. 


—t— 


A surprise something-or-other from DEC, the 
vT55, represents a breakthrough of some sort. But 
what were they thinking of? 

"Graphic capability" has been added to an 
ordinary upper-case keyscope. Specifically, the 
ability to make two graphs, i.e., two wiggly lines 
(no more) somewhere between the left and right 
sides of the screen. You can also shade in under 
them, and add coordinate grids. It's $2500, and 
obviously great if you're bonkers for 2D graphs. 


Guess WHO's Connie To SNEIEQ 


IBM, which did not take part in its develop- 


ment, is sponsoring a $100,000 CHARGE installation 


at the University of Waterloo, in Canada. 
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NOTE FROM THE AUTHOR 4 PUsLIEWER 


Labor Day, 1975 


MORE THANKS 


In banging together this 
volume originally, I omitted 
thanking Hesh Wiener, brazen & 
brash young old-fashioned new 
editor of Computer Decisions, 
who has changed that publica- 
tion from stolid to peppery. 

Thanks also to my good 
friend Robert W. Fiddler, Esq.; 
patent attorney and still an 
ex-philosophy professor at 
heart, for many delightful and 
witty conversations on problems 
of patent, copyright and the 
vagaries of intellectual prop- 
erty. Any harebrained ideas on 
these topics expressed here, 
however, are almost assuredly 
my own. 

For much of the informa- 
tion in this supplement I am 
grateful to Bob Albrécht of 
PCC, mentioned here and there. 

Finally, special thanks 
to Commander Hugo McCauley, 
better known to you as Hugo's 
Book Service, for his yeoman 
performance in shipping out 
the books-- not to mention car- 
rying them up and down stairs, 
typing the mailing labels, 
checking for bad ones, and 
sending out all those notes of 
apology when we were out of 
books again and again and again. 
And to long-suffering Lois and 
Megan McCauley, my especial 
gratitude. 


WHATEVER 


The sea-to-shining-sea 
Nelson Empire now consists of 
a lot of unsold books, a 1K Al- 
tair and a second pair of shoes. 
My scheme for taking on Appren- 
tice Generalists may have to 
wait awhile. So may Computer 
Lib,’ the film. But just wait. 

Speaking of which, what 
about this book, hey, now? 

Eventually there will be 
a new edition. Yes, the type 
is horrendously small, and that 
will have to be fixed. But 
that involves new negatives for 
every page, an expenditure of 
thousands of dollars, and: some 
reconsideration of how this 
should all be set up. 

There have been several 
interesting plans. One was to 
split the contents of this book 
into three books, add material, 
enlarge the type and have them 
each this size and price. Ten- 
tative titles were Computer Lib 
/Dream Machines, Computers 
Arise:/Computers Arouse!, and 
Guerrilla Computing/Electronic 
Monkeyshines. Sample cover, 
for Guerrilla Computing: King 
Kong climbing the front panel 
of a 370 holding Patty Hearst. 
(I also daydreamed about put- 
ting out a 10-volume encyclo- 
pedia in the same format, em- 
bracing psychology/sociology, 
biology/evolutionary strategy, 
history (as strategy) /more his- 
tory (as mood and feeling), 
revolution versus continuity 
(a two-sided position paper)... 
the Gem-Maniacal Encyclopedia™., 
But reason has prevailed, and 
such forays have been postponed 
indefinitely. 

The present plan is for 
Computer Lib to be rewritten 
and reset in bigger type, at 
least 256 pages, with at least 
8 color pages and color cover. 
(We're talking about fall '76 
or later.) Price will have to 
be $15. If you think that's a 
ripoff you can still get this 
one. (A number of people have 
complained to me about the $7 
price tag of this volume. Have 
they ever bought other books?) 
Later I would like to put out 
an anthology of my favorite ar- 
ticles in the field, using the 
Computers Arise:/Computers 
Arouse:! title and format, and 
with some good 3D if possible. 
In any case, I want. to stay in 
the publishing game; I haven't 
had so much fun in years. Oth- 
er projected volumes include 
The ‘Inner Beyond, by Sheila 
McKenzie; Dirty Driving and the 
Strategy of Traffic by "Driver 
Ed;" and The Nelson Computer 
Glossary. Soon I hope to be 
able to typeset from my own 
computer, and possibly to share 
this facility. 

This has been a most in- 
teresting year. I have been 
pleased to meet, and otherwise 
enjoy, the variety of clever, 
charming and/or lubricous per- 
sons who have sought me out 
since the book first appeared; 
as well as all the speaking en- 
gagements, soirees and whatnot. 

I am delighted to receive 
relevant material and communi- 
cations of any kind, although 
problems of time, disorganiza- 
tion and mood often preclude 
a Personal Type Reply. 

It has been a real lift for 
my morale to share some of these 
ideas and enthusiasms with a 
wider public at last. It is 
you, finally, who have to care; 
and I am very glad you do. 


As to the most important 
matters, there is a news black- 
out for the indefinite future. 
Please stand by. 


Next year in Xanadu. 
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This book (both sides) is based in part on my talks at or before 


the American Chemical Society, 


the American Documentation Institute, 


the American Management Association, the Associated Press, the Asso- 


ciation for Computing Machinery, 


the Central Intelligence Agency, the 


Institute of Electrical and Electronics Engineers, the Printing and 
Publishing Association, the Rand Corporation, the Society for Infor- 
mation Display, the Society of Motion Picture and Television Engineers, 
TIME Incorporated, Union Theological Seminary (the Auburn lectures), 


Xerox Palo Alto Research Center, 


and various art schools, colleges, 


universities and Joint Computer Conferences. 
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Everybody at Chicago Circle Campus 
has been very sporting about this project. 
I am grateful not only for the encourage- 
ment and assistance of various individuals 
“(especially Joseph I. Lipson, David C. 
Miller and Samuel Schrage), but for the 
atmosphere of support which has made this 
possible. My thanks to the Department of 
Art and the Office of Instructional Re- 
sources Development for freeing me from 
teaching duties, to the Computer Center 
and the Department of Chemistry for let- 
ting me use pictures of their equipment, 
and everybody for their encouragement. 


I would like to thank the Walt Disney 
organization for their permission to de- 
pict their wonderfu} characters, and ev- 
eryone else who furnished materials and 
permissions for the things herein. 


Thanks also to those who looked over 
some of the material, especially Herbert 
Grosch of Computerworld, Dan McGurk of 
the Computer haste Association, and 
William Rodgers. 


I am particularly grateful to the 
many who have explained computers to me 
over the years, especially Dave Denniston, 
Robert Fenichel, Andrew J. Singer, John 
R. Levine. 

My thanks to Tom Barnard for some of 
the early typing, and for the Porta-Xan. 


I. am grateful to Computer Decisions 
magazine for their good will, and help in 


researching computer image synthesis. 


My roommate Tom DeFanti, mentioned 
elsewhere in this book, has been consid- 
erate beyond the call of duty in giving 
over all the first-floor rooms of our 
house to this project for six months. 


My thanks finally to the many others 
whose good will has kept me going, in 
particular my former wife and eternal 
friend, Deborah Stone Nelson. 


Special greetings to my friend and 
neighbor, Mrs. John R. Neill: I hope you 
enjoy the uses which your husband's il- 
lustrations of Tik-Tok the Machine Man 
have found here. 


Lastly, for her contributions to 
morale (and for not footprinting the 
pasteups), let's have a warm hand for 
Pooky the Wonder Dog. 


fooky THE 
WONDER DOC, 
wWONnvEeR ING 


The occasionat Oz illustrations are ail by 
John R. Neill, from various out-of-copyright Oz 
books by L. Frank Baum, especially Ozma of Oz 
and Tik-Tok of Oz. Tik-Tok, the Machine Man, 
is the figure to whom occasional allegorical sig- 


HRE We MATERMLIC TIC? 


Persons of sagacity have been saying for 
some time that we are materialistic. 


In an important sense this is not so. 


The machines, and toys, and involvements 


we buy into, are in but a small proportion of 
cases owned simply as scores, for their cost 
as consumption symbols. _ 


Rather, we buy things that REPRESENT 
IDEALS, hoping ourselves to partake of some 
abstraction or image-- the Playboy man, the 
Smart Businessman, the Clever Homemaker. 


Each product tries to tell us it is the key- 
stone of a way of life, and then, at least at that 


moment of purchase, we step into, we embrace 
that way of life, covering ourselves with the 


feeling, the aura, the magic we saw in the com- 


mercial. 


This is not materialism. It is wishful 
grasping at miasma. (Following sentence op- 


tional.) It is communion, with the object seized 


simply the Objective Correlative of a hoped-for 
transsubstantiation. (Sorry.) It's a seeking, 
not to possess,“ to belong. 


Ou 


CET KINELICHN 
MACHINE: DIZEAMERL 


D.W. GRIFFITH-- took the movie-box and created 


the photoplay, no longer a twisted stage 
production. 


WALT DISNEY-- created a hypnotic pantheon of 
kindly and innocent semi-animals, senti- 
mentally universal, generally acceptable. 


JOHN W. CAMPBELL-- as author and then editor 


of Astounding, turned American science- 
fiction from the Buck Rogers space opera 


to the human story, built around thought- 


out premises and structures. 


IVAN SUTHERLAND-- programmed and systematized 


a computer setup for helping people think 
and work with deeply-structured pictorial 


information. (See p.dm 3. ) 


DOUG ENGELBART-- foresaw the use of computer 


screens as a way of expanding the mind, 
and over the last decade and a half has 
brought about just that. 


And more, and on. 


See 


ANOTHER QUICKIE 


Compare Alice, when she gets to Wonderland 
("Deary me! Curioser and curioser!") 
with Dorothy Gale, transported to Oz 
("How do I get back to Kansas?!!!") 
Fantasy ties in with everything, including 
American git-out-n-do-it. 


nificance is attached here by juxtaposition. 


The Oz picture in this spread is from 
The Patchwork Girl of Oz. 
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Thought you might wonder. 


OUT THE DOOR IN '74 


I have wanted to write an introduction to computers, and a separate book on Fantics, for years. 
But the idea of binding them back-to-back in a Whole Earth format, with lots of mischievous Enrich- 
ment material, didn't hit me till Jan 73. I have tried to add all the stimulating and exhilarating 
stuff I could find, especially personalizations, as on the other side; computers are deeply personal 
machines, contrary to legend, and so are showing-systems. I regret having to throw so many of my 
concerns into comic relief, but I hope that some readers will sense the seriousness below. 


The final inspiration for this book came from something called the Domebook, that tells you 
straightforwardly how to make Geodesic Domes. And of course I'm blatantly imitating, in a way, the 
wonderful Whole Earth Catalog of Stewart Brand. As I think back, though, the tone also comes in part 
from Pete Seeger's wonderful banjo book, and Tom McCahill's automobile reviews in Mechanix Illustrated. 
As to the last aspect, that of taking my case to the public because the experts won't listen, the only 


precedent I can think of is Maj. Alexander de Seversky's Victory Through Air Power, telling the coun- 
try how he thought we should win World War II. 


This project, simple ‘in principle, has been infinitely bothersome. Self-publication was neces- 
sary because no publisher could have comprehended the concept of this book; I heartily recommend Bill 


NY 10701. 


The present product is not the book I had meant to write. Most is first-draft; how the sentences 
do ru. on. (Believe it or not, I do not like underlining things-- a first-draft expedient.) Fact- 
checking and bibliographies had to be largely abandoned. Better planning could have increased 
type size; and so on. Half the manuscript, and the glossary, had to be kicked aside; including sec- 
tions on movies, "multi-media," microfilm, training simulators, augmented stage productions of the 
future, and goodness knows what. Sorry for all that. 


... WITH A LITTLE HELP FROM MY FRIENDS 


This project could never have been completed without the dedicated and extraordinary efforts of 
my wise and warm friends Sheila McKenzie and Wade Freeman, both faculty members at Circle, who have 
my deepest gratitude. They gave months and weeks of their good time to the tedious aspects of this 
project (which I continuously underestimated.) I hope it has been worth their work as well as my own. 
Ms. MeKenzie, whose concern for intelligent change in education drove her to boundless efforts on 
this project, has also my deepest admiration. 


The sad thing about it all is that 90% of these efforts are. unnecessary. A decent computer text 
system (of which only a couple exist as yet) would have obviated all the finding-and-retyping problems. 
I feel deeply for everyone who has trouble writing by conventional means, and who wouldn't if only 
decent systems were available. 


GREAT 
Werenl DREAMER 


I already said on the other side that the 
computer is a Rorschach, and you make of it 
some wild reflection of what you are yourself. 
There is more to it than that. 


America is the land where the machine is 
an intimate part of our fantasy life. 


Germans are too literal, they can get off 
on well-oiled cogs. The French are too vague. 
d've noticed that German science-fiction maga- 
zines had covers of machines and planets; French 
science-fiction magazines, of dragons and people 
with wings. Our science-fiction covers show 
people with machines. Intimately , emotionally.) 


German fantasy is icy and impersonal, French 
fantasy too personal, and American fantasy is 
splat in the middle, uniting both: man and 
machine, means and ends, emotion and details. 


Men always longed to fly, but it was here 
that they first did. This is the land of the 
MOVIE, a fantasy fabricated with endless diffi- 
culty using various kinds of equipment. 


The mad tinkerer is a fabled character 
in our fiction. 


This is the land of the kandy kolor hot 
rod, the Hell's Angel chopper, the drive-in 
movie. And the wild hot-rod, in fact, is just 
the flip side of the deep-carpeted Cadillac: each 
is a fantasy, an extension of its owner's image 
of himself in the world. 


Thus it was not an historical accident, 
but utterly predetermined, that in the hands of 
Americans the computer would become a way of 
realizing every conceivable wild fantasy that 
was dear to them. 


This is perfectly all right. This is as it 
should be. This is the best part of our culture. 
Not "Let a hundred flowers bloom," but "Let a 
hundred gizmos clank." This has sped immeas- 
urably the imaginative development of many dif- 
ferent things we might want. I try here fairly 
to explain a few differences among them. 


There is just one problem with all this. 
Now that all these things exist, or come nearer 
to existing, which ones will other people want? 
What will it be possible for everyone to have? 
And how can we tie all these things together? 


(Note: this thesis is being advanced 


only half-seriously. There have been a 


number of exactly-dreamful Frenchmen, and 


for this three-nationality split to be 


really true, they would all have to have 
come from Alsace, next to Germany: Jules 
Verne, Daguerre, the brothers Montgolfie:, 


the brothers Lumiere, to name a few.) 
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perhaps it is time 


THE LEGEND OF HYPER- MAN 


In the fantasies of their subjects, which they 
feel are the precursors of new artistic images 
that will in turn actualize themselves as another 
form of being, Masters and Houston see a new 
hero figure constantly recurring. This new hero 
is not the old “hero of a thousand faces,” the 
individualist who suffers, dies, and is reborn, 
slaughtering and conquering along the way. In- 
stead, he is Protean, capable of infinite changes 
in appearance and style, a magician, a Baltha- 
zar bringing gifts. He ruptures categories and 
confuses the senses, and in doing so he holds 
out the promise of fusion on a higher level. 

If such a hero were to become the model for 
the approaching age, he would probably not be 
the founder of a mass movement or the god of 
a new religion. He would be more elusive, more 
changeful than his predecessors. He would be a 
sorcerer who treats the external world and the 
internal world on equal terms, giving spirit to 
the former and flesh to the latter. He would be 
a master of paradox and a player of games, 
speaking a new language. His one prayer might 
be the lines of Blake: 


May God us keep 


From single vision 
And Newton's sleep. 


-- Kenneth Cavander, 


"Yoyage of the Psychenauts." 


Harper's, Jan 74, p. 74. 


; gers 
Theodor Holm. 
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APPARATUSES 
OF APPARITION 


It seems different companies are all the 
time introducing wonderful new devices that will 
revolutionize, uh, whatever it is we do with, uh, 
information and stuff. Things you'll attach to 


your TV to get highbrow programs or dirty movies. 


Microfilm devices that will shrink the contents 
of the Vatican Library to a dot on your glasses. 
Goggles that show you holographic color movies. 
A pince-nez that lets you see the future. And 
so on. 


Reading Popular Mechanics or the Saturday 
review of patents in the New York Times, you 
get the idea of Something Big, New and Wonder- 
ful About to Happen, so we'll all have access to 
anything, anytime, anywhere. 


But it's been that way for decades, and 
with certain exceptions hasn't happened yet. 


Here are some things that have caught on, 
and are mostly familiar to us all. 


Book. Newspaper. Magazine. Radio (AM). 


Phonograph record (78). Tape recorder, }". 
Black-and-white television. Radio (FM). Phono- 
graph record (33). Phonograph record (45). 
Color television. Tape cartridge (4"). Tape 
cassette (Philips, ca. 1/8"). Stereo records 
and tapes. Oh yeah, and movies: 35mm, 16mm, 
8mm, Super 8mm. Carousel projectors. View- 
master stereo viewers. 


Here are some things in the process of 
catching on (and not assured of success): 
Quadrophonic sound. Dolby. Chromium dioxide 
tape emulsion. Super 16 movie format. 


But for everything that did catch on, dozens 
didn't. Some examples: 12-inch 45 rpm records. 
11.5 millimeter movies. RCA's 34-inch tape cart- 
ridge, which became a model for the much smaller 
Philips. Wire recorders. 


Then there are the things that caught on 
for awhile and went away. Stereopticons (and 
their beautiful descendant, the Tru-Vue, which 
I loved as a kid). Cylindrical recordings. 
Piano rolls. And so on. 


Then there are the video recording sys- 
tems. CBS' EVR died before it got anywhere. 
RCA's SelectaVision isn't out yet. 2-inch quad 
is standard in the studios, }-inch Porta-Pak 
is standard among the Video Freaks, and it looks 
like Sony's 3/4" cartridge will win as the main 
sales and storage medium. (The Philips system 
here looks as though it won't make it, and 1l-inch 
is dubious.) But what's this we hear about 
video disks (twenty-five years after they announ- 
ced Phonevision. Ah, well.)? 


The thing is, so many of these things seem 
to sound alike. They all mention "information 
retrieval," education, technology, possibly "the 
information explosion" and "the knowledge in- 
dustry." Press releases or effusive newspaper 
articles may use phrases like "space-age," 
"futuristic," "McLuhanesque" or even "Orwellian" 
(though few people who use that word seem to 
know what Orwell stood for; see pba ). 


And the intimidating company names! 
Outfits with names like General Learning, Inc., 
or Synergistic Cybernetics, Inc., or even 
Communications | Research | Machines, Inc. 
Surely such people must know what they are 
doing, to use such scientific-sounding phrases 
as these! 


Then there are the business magazines. 
In the late sixties they were talking about "The 
Knowledge Industry" (a fiction, it turned out, 
of an economist's lumping a lot of things together 
oddly). Now they talk about the Cable TV out- 
fits and the Video Cartridge outfits as though 
they're the cat's pajamas. 
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Emblem of 2d International Animation Film Festival 


in New York, Jan 74. © walt Disney Productions. 


THERE'S SNOW BUSINESS LIKE SHOW) BUSINESS — 


You Can't Tell the Experts Without They Program You x 
(Cf. "Calling a Spade a Spade, p.] 2.) 


BABELS IN TOYLANN 


Guy's Background Tell-Tale Phrases & Jargumentation 
Television: "Media" (meaning television); 
1. Video freaks "Software" (meaning videotapes). 
2. Network People "Programming" (meaning competitive scheduling); 


"Software" (meaning fixed-length TV shows). 

3. Cable Operators Head end, upstream & downstream, back-channel, 
"interactive TV" (meaning any form of interactive 
computer system they can get in on). 


Math/Engineering 


Information theory, channel capacity, bandwidth, 


feedback, anything complex and irrelevant. 

Display Engineering Full duplex, echoplex, aspect ratio, scroll, cursor; 
"information transfer" (meaning telling or teaching); 
"data delivery" (act thereof). 


Programmed "Software" (meaning sequential or branching tell-&- 
Instruction , test materials); "Programming" (creating these); 
Computer-Assisted reinforcement schedules (meaning presentational order); 
Instruction "inputs" (meaning ideas and information); "feedback" 


(meaning replies); "simulations" (meaning pictures or 
events a user can influence). 


Publishing "Software" (meaning books). 

Advertising, ‘"Demographics" (meaning factions); campaign scrategy 
Public Relations, (meaning how you hit a market); "penetration" 
Marketing (meaning extent to which your stuff catches on); 

"Programming" (meaning anything whatever). 

Artificial Intelligence Anything mathematical; theorems, discriminators, neural 


nets; "programming" (meaning setting up anything 
very complicated and incomprehensible). 
McLuhanatic Global Village, mosaic, surround; "Programming" 
(meaning psychological indoctrination); anybody 
else's terms, dynamically infused with new senses. 
Nelsonian Medium (meaning stabilized presentational context); 
Writing and Creation (meaning thoughtful production 
of something presentable, whether sequential or not, 
in a medium); "Programming" (meaning giving 
exact instructions to a computer); media integrity, 
inventions & conventions; hypertext, thinkertoy, fantics. 


Having spent some considerable time around 
and among these areas, I have developed consid- 
erable cynicism and a bad case of the giggles. 
Originally it all seemed to fit together and to be 
leading somewhere, but talking to people at all 
levels, and either giving advice or trying to 
interpret the advice of others, I am convinced 
that what we have here in this whole audio- 
visual-presentational whizbang field is nothing 
less than a very high order of collective insanity. 
The strange way companies adopt and drop var- 
ious product lines, and verbalize what they think 
they are doing, seem to me a combination of 
lemmingism and a willingness to follow any Auth- 
ority in an expensive suit. I have talked to 
enough vice-presidents and presidents of compu- 
ter companies, publishing companies, networks, 
media outfits and so on, to be totally certain 
that they have no special knowledge or unusual 
basis of information; yet these people's remarks, 
as amplified through the business reporters, 
send the whole nation a-dithering. There are 


times I think everybody in Media is either deluded, 


misguided, lying or crazy. 


THREE CRUCIAL POINTS. 
1. SYSTEMS "IN THE HOME." 


The emphasis has changed from trying to 
sell snazzy systems to the schools (which don't 
have the money) to the home. This in turn 
has convinced most people that the new systems 


have to be very limited, like jimmied-up TV sets. 


(We easily lose track of the fact that you can 
have anything "in the home" if you want to pay 
for it; and an economy in which Marantzes and 
snowmobiles have caught on big indicates that 
some people are going to be willing to pay for 
really hot stuff.) 


2. CATCHING ON. 


The key question is not how good a system 
is in the abstract, but whether it will catch on. 
(Obviously if we're public-spirited we want the 
best systems to catch on, of course.) 


This matter of Catching On is a fickle and 
crucial business. 


According to one anecdote, Mr. Bell 
couldn't interest anyone in his invention, which 
he was showing at some trade fair. Then who 
should come by but the Emperor of Brazil (!), 
who was about to leave with his retinue of ad- 
visers. "What is that?" asked the Emperor of 
Brazil. "Nothing to bother with," they said, and 
tried to rush him by, but he stopped and loved 
it, and ordered the first pair of telephones sold. 
This made the headlines, and the sale of tele- 
phones began. 


Another anecdote. It is legendary that 
inventors overvalue their own work. Yet after 
Thomas Edison had invented the kinematograph, 
or "moving picture," a device you looked into 
turning a crank, he declined to build a projector 
for it, saying that the novelty would wear off, 
Obviously he did't quite see what "catching on" 
would mean here. 


Wonderful Systems That Were Gonna Be 


WHERE ARE THE SHOWS 
OF VESTER YER? 


I once read a mind-blowing review article in 
Films in Review, early sixties I think, 
on schemes to make three-dimensional 
movies before 1930. There were dozens. 


Then there was that multiscreen film Napoleon 
-- a legend-- done in the nineteen-twenties. 
(That one really existed.) 


Phonevision, about 1947 or so, was going to 
store a half-hour movie on a 12-inch disk. 
Did they get the idea from the LP? Did 
they really think they could do it? 


The German photo-gizmo, around 1950: a special 
camera that supposedly created a sculpture 
of what it was pointed at. (But how did 
it know what was behind things?) 


A weird lens around 1950-- I think it was depic- 
ted as having a blue center and a red peri- 
phery, like a fifties hoodlum tail-light-- 
that was somehow going to find "residual 
traces" of color in black-and-white pictures, 
and make 'em into color, zowie, just by 
copying them. 


Then there was the Panacolor Cartridge. During 
the Days of Madness-- 1968, I think it was 
-- a rather good little movie gadget was 
being pushed by a firm called Panacolor. 
It had ten parallel movie and audio tracks, 
I believe, on a 70mm strip. The prototypes 
were built by Zeiss. 
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Their idea was that this was a com- 
pact movie projector. I kept trying to per- 
suade the company's president that they had 
inadvertently designed a splendid device 
for branching movies (see "Hyperfilms," 


p Phd ). 


Exercise for the reader: map out prop- 
erties of the branching and expository 
structures implicit in such a device. (t's 
one-directional. Gotta rewind when you 
get to the end. But you can jump between 
tracks when it seems appropriate.) 


Anyway, it's gone now. 


THING THAT'S HAPPENING A 
NO-ONE WI BE LEFT OUT. 
NORMAL / 


The Great Robert Crumb. 
(From Zap Comix #0.) 


: Ih The news * 
theve is no twih* *, 


and ih the Trvih**, 


i" 
there is no news™®, 


ae Modera Russian proverb, 
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HARDWARE, SOFTWARE AND WHATNOT (reprise) 


Among the many odd things that have 
resulted from the collision of computer people 
with educators, publishers and others has been 
the respectful imitation of computer ways by 
those who didn't quite understand them. Again, 
the cargo cult.* 


The most dismal of these practices has been 
the adoption of the term "software" for any intel- 
lectual or artistic property ** This wholly loses 
the distinction, made on the other side of the book, 
between: 


hardware (programmable equipment) 


software (programs, detailed plans 
of operation that the hardware 
earries out) 


contents or data (materiel which is 
worked on by, moved in or 
presented by the hardware 
under control of the software) 


In other words, hardware and software 
together make an environment; data or contents 
move and appear in that environment. 


The publishing-and-picturefolk have missed 
this distinction entirely. Not realizing that their 
productions are the contents (material, matter, 
data, stuff, message...) that come and go in the 
prefabricated hardware-software entironments, 
they have mushed this together into a state of 
self-feeding confusion. 


(The matter has not been helped by the 
computer-assisted instruction people-- see p. Dm 15 
-- whose branching productions seemed to them 
enough like computer programs to be called 
"software .") 


* Primitives exposed to "civilized" man imitate 
his ways ridiculously «in religious rituals, 
hoping for the shipments of canned goods, 
ete. that his behavior seems to bring down 
from parts unknown. 


on 
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¥* "Mere corroborative detail, 
to enhance an otherwise 
uninteresting narrative..." 


Pooh-Bah, 
Lord High 

. Everything 
Else 


3. STANDARDIZATION 


In order for something to Catch On, it has 
to be standardized. Unfortunately, there is mo- 
tivation for different companies to make their own 
little changes in order to restrict users to its 
own products. The best example of how to 
avoid this: Philips patented its audio cartridge 
to the teeth, but then granted everybody free 
use of the patent provided they adhered to the 
exact standardization. The result has been the 
system's spectacular success, and Philips, rather 
than dominating a small market, has a share of 
a far larger market, and hence makes more 
money. That's a virtue-rewarded kind of story. 


The other problem with standardization, 
though, is that we tend to standardize too soon. 
We standardized on AM radio, even though FM 
would probably have been better. (One Major 
Armstrong, a great figure in the development 
of radio, committed suicide when nobody would 
accept FM. If he could only have heard our FM 
of today, he might have said "Oh, nuts," and 
lived.) 


Another example. When they designed the 
Touch-Tone phone pad, the Bell people evidently 
saw no reason to have it match the adding ma- 
chine panel, so they put "1" in the upper left 
rather than the lower left. Now there are lots 
of people who use both arrangements, every day, 
and at least one of them curses the designers' 
lack of consideration. 


Another interesting example of Catching 
On: during the early sixties, it was fun being 
at places where they were just getting Xerox 
copiers for the first time. Everyone would ar- 
gue that nobody needed a copier. Then, grud- 
gingly, one would be ordered. The first month's 
use invariably would exceed the estimate for the 
first year, and go up and up from there. 


The worst aspect of the confusion among 
the corporations is that certain deficiencies and 
crudities of vision slip into the mix. Unless 
our new media and their exact ramifications and 
concomitants are planned with the greatest care, 
everybody stands to lose. We must understand the 
detailed properties of media. (The first question 
to ask, when somebody is showing you the 
Latest and Greatest, is: "What are the properties 
and qualities of the medium?" The followup 
questions come easily with experience: How of- 
ten do you have to change it, what are the bran- 
ching options, what part could somebody acci- 
dentally put in backwards, are there distracting 
complications? etc. ) 


I am unpersuaded by McLuhan. His in- 
sights are remarkable, yet suspicious: he sup- 
poses that electronic media are all the same. How 
can this be? Here we may now decide what elec- 
tronic media we want in the future-- and this de- 
cision, I would say, is one of the most important 
we have to face. 


The engineers seem to be quite the oppo- 
site of McLuhan: somehow to them it's always a 
multiple-choice, multi-engineering problem, dif- 
ferent every time; "this technique is good for A, 
that technique is good for B." But the net ef- 
fect is the same: "electronic media are generally 
the same." I would claim that the're all differ- 
ent, all ten million of them (TV being only one 
electronic medium out of the lot), and the dif- 
ferences matter very very much, and only a few 
can catch on. So it matters very much which. 
Some are great, some are lousy, some are sub- 
tly bad, having a locked-in information structure, 
built deep-down into the system. (Example: 
the fixed "query modes" built into some systems.) 


One last point. Everybody only has a 
24-hour day. Most people, if they increase con- 
sumption of one medium (like magazines or books) 
will cut down on another (like TV). This dras- 
tically reduces the sorts of growth some people 
have been expecting. Except, now, if we can 
begin to replace some of the inane paper-shuffling 
and paper-losing of the business world, and 
replace the creepy activities of the school (as now 
generally constituted) with a more golden use of 
time and mind. Read on. 


THANATOPS? S 


A self-employed repairman of mobile homes 
named Donald Wells has invented a solar-powered 
tombstone that can show movies and still pictures 
of the departed, along with appropriate organ 
music and any last words or eulogies selected 
by the deceased. 


The device is activated by a remote control 
device carried by a visitor to the gravesite. 
The movies would be shown on a twelve-inch screen 
mounted next to the epitaph. 


"You could also have pictures of Christ as- 
cending to heaven or Christ on the cross, whatever 
you want," says Wells. "It adds a whole new di- 
mension to going to the cemetery...." 


Cleveland Plain Dealer 
(Quoted tn Nattonal Lampoon 
True Facts, May 74, 10.) 
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"The Emperor has no clothes on!" 


Small Boy 
(name withheld) 


Sa 
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Last year I actually heard a phone company 
lecturer say that in the future we 
will have "Instant Access to Anything, 
Anytime, Anywhere." 


What they're pushing is Picturephone, which 
it seems to me is unnecessary, wasteful 
and generally unfeasible. 


(See: Robert J. Robinson, "Picturephone-- Who 
Needs It?", Datamation 15 Nov 71, 152.) 


In any medium-- written, visual, filmic 
or whatever-- you generate instantaneously 
an atmosphere, a patina, a miasma of style, 


involvement, personality (perhaps implicit), 
outlook, portent. Consider-- 


The complacency of the Sulzbergers' 
New York Times-- 

The cynicism and mischief of Krassner's 
Realist-- 

The perkiness and sense of freedom of 
"Sesame Street"-- 

The personalized, focussed foreboding 
of Orson Welles films; as distinct 
from the impersonalized, focussed 
foreboding of Hitchcock-- 


Next to this matter of mood, all else pales: 

the actual constraints and structures of media, 
the expositions and complications of particular 
cognitive works and presentations within media, 


ps 
NWE Wy" IN THE CURSS ROOM 


Time after time, the educational establishment has 
thought some great revolution would come through getting 
new kinds of equipment into the classroom. 


First it was movies. More recently it's been "audio- 
visual" stuff, teaching machines, film loops and computer- 
assisted instruction. 


In no cases have the enthusiasts for these systems 
seen how the equipment would fit into conventional edu- 
cation-- or, more likely, screw the teacher up. Teachers 
are embarrassed and flustered when they have to monkey 
with equipment in addition to everything else, and fitting 
the available canned materials into their lesson plans 
doesn't work out well, either. 


The only real possibilities for change lie in systems 
that will change the instructor's position from a manager 
to a helper. Many teachers will like this, many will not. 


PAY CAREFUL ATTENTION 


when somebody shows you an electronic or other 
presentational system, device or whatever. 


A certain kind of slight-of-hand goes on. 
It's very easy to get fooled. They may show 
you one thing and persuade you you've seen 
another. 


And if you're canny enough to ask about 
a feature you haven't seen they'll always say, 


"WE'RE WORKING ON IT." 


It's only dishonest if they say, "It'll be ready 
next month." 
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VIDEO. Te happy medium? some sn 


Would you believe there was television broadcasting 
over the airwaves in the nineteen-twenties? The thing is, 
it used bizarre spinning equipment because there were no 
CRTs (see "Lightning in a Bottle," nearby.) Only with 
the development of radar in World War II did there also 
come a practicable Cathode Ray Tube, making home televis- 
ion feasible. 


But the big companies were at first very conservative 
in their marketing, figuring television would be a luxury 
item only. It took a man named Madman Muntz, who carica- 
tured himself in a Napoleon hat, to see that millions would 
buy television if the price was right. So he came out with 
Muntz TV in the late forties. As I recall, the Muntz TV 
cost $100 and had one tuning knob. (This was less intimi- 
dating than the row of knobs on more expensive sets.) I 
don't know how Muntz came out on it all, but his opening of 
the mass market made the bigger corporations realize it was 
there. (This same thing may yet happen again in newer 
media.) 


Originally all there was was Krazy Kat and Farmer 
Brown cartoons. But behold, sooner than you could say 
"vertical hold," there were Sid Caesar and Imogene Coca 
on the Admiral Show, and we were off. 


A quarter of a century later, the best of television 
is no better and the bulk of television is about as bad 
as it ever was. 


We "understand" television. That is, we know what a 
TV show is, how it fits together and so on. 


ICECUBES 


But what people don't realize about TV is that the 
governing feature is the time-slot. In any medium with 
time-slots, whether TV, radio or classroom education, the 
time-slot rules behavior. Whatever can happen is as con- 
strained as icecubes in a tray. 


This is the limiting factor when optimists try to 
use TV for teaching. If it's coming over a cable, every- 
thing has to be scheduled around it, and the contents are 
clipped and constrained to fit the time-slot. It may be 
better with videotape. 


CABLES 


In the last dozen years, Cable TV, or CATV, has 
become big business. A Video Cable is a high-capacity 
electrical carrier that runs through a given neighbor- 
hood or region. Business and individuals may "'sub- 
scribe" and get their own sets hooked onto the cable. 


What this does first of all is improve reception. 
The fouled-up video picture caused by such extraneous 
objects as the World Trade Center in New York can be 
corrected by hooking into the video cable: you get a 
nice, sharp picture. 


In addition, though, the cable offers extra channels. 


Now, the businessmen who have been throwing togeth- 
er these video cable outfits are aiming for something. 
They have been thinking that these extra channels would 
net them a lot of money: by showing things on them that 
can't be offered on the air— highbrow drama, or perhaps 
X-rated stuff-- they could get extra revenue. (You'd pay 
extra to watch it by buying an unscrambler, or whatever.) 


This is turning into somewhat of a disappointment. 


The cable people had foreseen, evidently, that people 
would stay home in droves to see the new offerings on the 
cable. In Show Business it's easy to forget, though, that 
everybody has only twentyfour hours in a day, and far less 
than 24 hours to dispose of freely; so every leisure occu- 
pation is competing with every other leisure occupation. 
Moreover, the residual leisure occupation, when there's no- 
thing else to do, is TV. It would seem that few people 
would watch more television if it were better, but many 
would watch less if they could afford to go out. 


EXTRA CHANNELS 


In recent years, a number of extra channels have been 
made available by law. These are the UHF, or Ultra High 
Frequency channels. These, like cables, represent a con- 
sumer breakthrough but will have only negligible impact. 


THE PROBLEM OF ORGANIZATION 


Whatever else you may say about them, the networks 
and TV stations are at least organized as going concerns 
within the institutional structures of the country. Ideas 
of "community television" and other such schemes which call 
for some new form of social organization to spring forth 
are about as plausible as "community control" of schools 
and police-- or at best likely to be as influential as 
"community social centers." 


INTERACTIVE TV? 


Some people, I won't say who, have gotten a lot of 
money for something they call "interactive television." 
What this turns out to mean is any form of computer time- 
sharing that will use home TV terminals and video cables. 
The questions are why use home TV terminals and video 
cables, insofar as they would seem to promise only com- 
paratively low-grade performance; and whether these people 
have thought out anything about the potential characteris-— 
tics of the various media they propose with such abandon. 
Nothing I have seen or heard about this is reassuring. 


"ALTERNATE" TELEVISION, or VIDEO FREAKS 


In recent years, many young folks have taken to video 
asa way of life. In the most extreme cases they say things 
like "the written word is dead," prompted perhaps by McLuhan. 

I have found it rather difficult to talk to video freaks. 
(It may be that some of them are against spoken words as well.) 
I really just don't know what they're about. 


The work of these people is as exuberant as it is strange. 
I haven't seen much of it or understood much of what I have 
seen. 


In some cases, "alternative television" simply means docu- 
mentaries outside the normal framework of ownership and report- 
ing. In one example cited by Shamberg (see bibliography) , 
video freaks did excellent coverage of the 1968 Republican conven: 
tion. People were allowed to speak for themselves, unlike "nor- 
mal" TV journalism where "commentators" tell you what they see. 


Now, this is hardly revolutionary; it is just good documen- 
tary-making that shucks dumb traditions artistically, much like 
the Pennebaker films. However, video enthusiasts claim it is 
somehow different, and indeed claim that video is different in 
principle from films. I have been unable to get a satisfactory 
clarification of this idea. 


Video is being used in other ways, harder to understand, by 
artists (best defined as persons called "artists" within the art 
world today). Very odd "video pieces" have been shown at art © 
shows, where the object seems to be to confuse the viewer-- or 
knock him into a condition of Enlarged Perspective, shall we say. 
And a variety of non-objective videotapes are now being created. 
(A gallery show in 1969 was called "Video as a Creative Medium" 
-- implying sarcastically that it had not been before, on the 
airwaves.) 


Some video freaks think of video as intrinsically radical or 
Revolutionary. In this respect they differ interestingly from, 
say, the editors of the National Lampoon. The editors of the 
National Lampoon appear to be political radicals, but do not sug- 
gest that the very media of cartoon and joke-piece are themselves 
revolutionary. Some video freaks appear to be persuaded that the 
medium of television itself is inherently a vehicle for change. 


I can understand one interesting sense in which this may be 
true: Shamberg talks about video as a method of self-discovery. 
Seeing yourself on TV does, of course, confer certain insights. 
But Shamberg suggests it may expand people's consciousness in 
larger ways-- allowing people to see the bleakness of certain 
pursuits (he uses the example of Shopping), for instance. But 
if this does hit home to people, it doesn't seem to me to be the 
medium that's doing it but the selected content-- as in all pre- 
vious media. Maybe I've missed the point in some way. 


These developments are all very interesting. It can be 
hoped that those trying to develop new forms of communication 
will make an effort to communicate better with those who, like 
the author, often cannot comprehend what they are doing. 


But decentralized transmission of 
information should be dominant, not fugi- 
tive. Each citizen of Media-America 
should guaranteed as a birthright access 
to the means of distribution of informa- 
tien.” 

(Shamberg, p. 67) 
y Well, we went down there with our 
Porta-Pak and tried to take it inside. 
A guard came over and said we couldn't 
and even threw one of us out of the booth 
while the other was inside. A guard 
telling you what to do ina cybernetic 
environment?" 


(Shamberg, p. 53) 


("Cybernetic" is evidently a code 
word here for what they think is 
good, true, beautiful and inevi- 
table. cf. p. DM 13.) 
3 About the only generalization to be 
made is that community video will be 
subversive to any group, bureaucracy, or 
individual which feels threatened by a 
coalescing of grassroots consciousness. 
Because not only does decentralized TV 
serve as an early warning system, it puts 
people in touch with one another about 
common grievances." 


(Shamberg, p. 57) 
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“SCANDAL IS RAMPANT in the cable 

television industry. Only Cable Re- 
port follows cable TV developments 
from the citizen's perspective and 
tells you what's happening and what's 
going wrong." Ad in Chicago READER. 
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THE CATHODE-RAY TURE 


A cathode-ray tube is actually a bottle filled 
with a vacuum and some funny electrical equip- - 
ment. The equipment in the neck of the bottle 
shoots a beam of electrons toward the bottom of 
the bottle. 


This beam of electrons is called, more or less for 
historical reasons, a cathode ray. Think of it as 
a straw that can be wiggled in the bottle. 


Actually the bottle is shaped so as to have 
a large viewing area at the bottom (the screen), 
and this screen is coated with something that glows 
when electrons hit it. Such a chemical is called 
a phosphor. 
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Now, two useful things can be done with this 
beam. 


1) It can be made brighter by increasing 
the voltage, which increases the 
number of electrons in the beam. 


2) The beam can be moved! That is, it 
can be made to play around the face 
of the tube the way you can slosh 
the stream of a garden hose back 
and forth on the lawn; or Wiggle a 
straw in a coke bottle. The beam 
can be moved with either magnetism 
or static electricity. This is applied 
in the neck of the bottle-- or even 
from outside the neck-- by deflection 
plates, whose electrical pulsations 
determine the pattern the beam 
traces on the screen. (Note that the 
beam can be moved on the screen at 
great speed.) 


The vertical deflection plates can pull the 
beam up or down on the screen, controlled by 
a Signal to them; 


the horizontal deflection plates can pull the beam 


Sideways on the screen, controlled by a signal 
to them. 
«\ 
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By sending combined Signals to both hori- 
zontal and vertical deflection plates, we can make 
the end of the beam-- a bright dot on the screen, 
sometimes called a flying spot-- jump around in 
any pattern on the screen. A repeated pattern 


of the beam on the face of the CRT is called a 
raster. 


From these two capabilities-- brightening 
and moving the beam-- a number of very special 
technologies emerge: 


TELEVISION uses a zig-zag scanning pat- 
tern which repeats over and over. 
This zigzag pattern is always the 
same, night and day. 


You can usually see the lines clearly 
on a black-and-white set. The pic- 
ture consists of the changing pattern 
of brightness of this beam, which 
comes in over the airwaves as the 
television signal. 


RADAR DISPLAY uses a CRT to show reflec- 
ted images around where the radar 
antenna is standing. This uses a 
scanning raster of a star shape, 
brightening the beam when reflected 
images are received. 


COMPUTER CRT GRAPHICS generally use 
the CRT in still another way: the 
beam is moved around the screen in 
straight lines from point to point. 
(Between different parts of the pic- 
ture the beam is darkened, turned 
very low so you don't see it.) 


Because the image on a normal 
CRT fades quickly, the computer must 
ordinarily draw the picture again and 
again and again. (Methods for this 
are discussed on p. PM 22-8.) 


SPECIAL KINDS OF CATHODE-RAY TUBES 


The CRT is not merely a single invention, 
but an entire family of inventions. The ordinary 
CRT, which we have discussed, is viewed at one 
end by a human being, has an image which fades 
quickly, and can have its flying spot driven in 
any kind of raster or pattern. 


Here are some other kinds of CRT: 


The picture transmitter, which has different 
versions and names: Vidicon, Image Orthicon, 
Plumbicon,. etc. THIS IS THE MAGICAL DEVICE 
THAT MAKES THE TELEVISION CAMERA WORK, 
AND YET, BY GOSH, IT'S JUST ANOTHER CRT. 
Except instead of the picture coming into it as 
an electrical signal and out of it as an optical 
image, the picture comes into it as an optical 
image and goes out of it as an electrical signal: 


How can this be? 


The. tube sits inside the television camera. 
which is an ordinary camera, like, with a lens 
projecting a picture through a dark chamber 
onto a sensitive surface. But instead of the 
surface being a film, the surface is the faceplate 
of a CRT with some kind of a special pickup 
phosphor: 
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The electron beam, which is just like any 
other electron beam, is made to zigzag across 
the faceplate in a standard television raster. 
And the special phosphor of the tube measures 
the brightness of the picture at the spot the 
beam is hitting. I have no idea how this hap- 
pens, but it's chemical and electronical and mys- 
terious, and is based on the way the phosphor 
interacts with the light from one side and the 
electrons from the other side at the same time. 
Anyhow, a measurement signal comes out of the 
faceplate, indicating how bright the projected 
picture is in the very spot the electron beam is 
now hitting. 


As the beam criss-crosses the faceplate in 


the zig-zag television raster, then, a continuously 


changing output signal from the faceplate shows 
the brightnesses all across the successive lines 
of the scan. 


And that is the television signal. Together 


with synchronizing information, it's what goes 
out over the airwaves, down your antenna and 
into your set. Your set, obeying: the synchron- 
izing information, brightens and darkens its own 
beam in proportion to the brightness of the 
individual teeny regions of the faceplate in the 
television camera. And this produces the scin- 
tillating surface we call television. 
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The color tube is a weird beast indeed. 
There are several types, but we'll only talk 
about the simplest (and many think the best), 
Sony's Trinitron(TM) tube. 


This is an ordinary CRT which has, in- 
stead of a uniform coating on the faceplate, tiny 
vertical stripes of three primary colors-- red, 
blue and green. (You thought the primary col- 
ors were red, blue and yellow, didn't you. If 
you're mixing pigments that happens to be true. 
For some ungodly reason, however, if you're 
mixing lights, the colors that yield all others 
turn out to be red, green and blue; it turns out 
that yellow light can be made out of red and 
green. If you don't believe me go to a chintzy 
hardware store, get a red and a green bulb, 
turn 'em on and see what happens in a white- 
walled room.) 


At any rate, color television uses addi- 
tional color signals, and in the Trinitron these 
control the response of the faceplate. If the 
color signal says "green" as the electron dot 
crosses a certain part of the screen, the color 
signal tells the green stripes that they're free 
to light up when hit. If it's Yellow Time, the 
signal tells both the red stripes and the green, 


and so side by side they light up red and green, 


as the beam crosses them, but the total effect 
from more than a few inches is Yellow. 


Most American color TV sets, however, at 
least up till this year, used something very dif- 
ferent, something entirely weird called the 
Shadow Mask Tube. I'll spare you the picture, 
but there were several different electron beams 
-- often referred to jokingly as the "red electron 
beam," "blue electron beam" and "green electron 
beam," though of course they were identical in 
character. These hit a perforated sieve, up 
near the screen, called the shadow mask, and 
the color signal tweaked the unwanted beams 
so they did not hit different-colored phosphor 


dots that were intricately arranged on the screen. 


I'm sorry I started to explain this. 


Multigun tubes have more than one electron 
gun and more than one electron beam. They 
can be used in different ways (aside from the 
old shadow-mask TV tube, mentioned above). 


For instance, one gun can be driven in a 
video raster, to show television, while another 
gun can be used as a computer display, drawing 


individual lines with no regard to the TV pattern. 
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The storage CRT comes in two flavors: 
viewable and non-viewable. But what it does 
is very neat: it holds the picture on the screen. 
The mechanisms for this are of various types, 
and it's all weird and electronic, but the idea 
is that once something is put on the screen by 
the electron beam, it stays dnd stays. , UP to 
several minutes, usually. The main manufac- 
turers are Tektronix, Princeton Electronic Pro- 
ducts, and Hughes Aircraft; each of these three 
has a product that works by a different method. 


Note: Tektronix' tube is built into. a num- 
ber of different computer displays, and is rec- 
ognizable by its Kelly green surface. They 
themselves make complete computer terminals 
around this scope for $4000 and up, but lots of 
other people put it in their products also. It 
shows whatever has already been put on the 
screen, and the electron beam does not have to 
repeat the action. However, it usually only 
stays lit for about a minute. 


Princeton Electronic Products (guess where) 
is a much smaller outfit, so perhaps it is appro- 
priate that they make a much smaller storage 
tube. It is about one inch square at its storage 
end, and you don't look at it directly. Instead, 
an image can be stored on it either wth a TV 
raster or by computer-driven line drawing. 
After the image is stored on it, though, it func- 
tions as a TV camera: the picture stored on the 
plate can be read out with a scanning raster, 
exactly as if it were a picture transmitter in a 
television camera. The Princeton folks have 
built a quite expensive, but quite splendid, 
complete terminal around this device: it can hold 
both video and computer-drawn pictures, super- 
imposed or combined, and sends them back out 
in standard black-and-white TV. $12000. 


CRTS which bring in a picture one way 
(such as a video raster) and send it back out 
another way (such as by letting a computer 
search out individual points) are called scan 
converters. yea 


A word about this last method. It is often 
desired by computer people to turn a picture 
into some form of data (see p.’,,)). Sean conver- 
ters, usually by the three manufacturers named 
above, can be hooked up to let the computer pro- 
gram poke around in the picture and measure the 
brightness of the picture in arbitrary places. 
A device which examines the brightness of some- 
thing in arbitrary places is called a flying spot 
scanner.) Here are some different kinds of 
flying-spot scanners: 
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} have heard it said that it might be pos- 
sible to build a CRT with a changeable mirror 
surface: that is, the screen becomes mirrored 
temporarily where it is being hit with the elec- 
tron beam. Interesting. This would mean that 
you could make computer displays (and TV) 
bright and projectable to any degree, say, by 
pouring a super-intensity laser beam on it. "Be 
great for writing 'Coca-Cola' on the moon," says 
a friend of mine. If you believe in astral pro- 
jection. 


3IBLIOGRAPHY: Color TV Training Manual, Sams & Co./ 
Bobbs—-Merrill ($7), is a well-illustrated and 
intelligent introduction to the TV use of CRTs. 
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SANDIN'S 
IMAGE P 


Dan Sandin, 
professor of Art 
at U. of Illinois, 
Chieago Ctirele, 
says very wtse 
things (having 
been a phystctst), 
and we were going 
to have a whole 
sectton on that, 
but as you can see 
there wasn't room. 


Daniel J. Sandin (pronounced san-DEEN) has 
spent the last several years putting together a 
device he currently calls the IP (Image Proces- 
sor). It's a system of circuits for changing 
and colorizing TV. What follows is the first 
published description of it. 


I regret that the following is probably 
one of the most difficult sections of this book. 
(If you know nothing about video, read ~ 
steepare first.) Tyo 7) 


The idea is basically to create a complete- 
ly generalized system for altering the color and 
brightness of video images. (I.e., the system 
does not move them on the screen. Thus it 
differs from the Computer Image line of video- 
twisting graphics systems, which alter positions 
of objects; see p. DM 34 ~- Note also that 
rather similar facilities éxist as part of, e.g., 
the Scanimate system, p. DM 8 .-) 


This means that basically Sandin's system 
plays with the part of the TV signal called z, 
or brightness (as distinct from x or y, the sig- 
nals for horizontal and vertical movement of the 
dot. See oppesite—pege). 

mM 


Now, as a physicist and field-theoretician, 
Sandin approached this as a problem in generality; 
and indeed, the style of generalization should be 
appreciated. Sandin repeatedly chose flexibility 
and power rather than obviousness in the parts he 
created. The resulting system is both parsimon- 
ious and productive. 


His first important decision was that all 
parts of the system should be compatible and idiot~- 
proof, so that any user could frivolously plug it 
together any way at all without burning out the 
circuits. 


Indeed, Sandin decided to build it like a music 
synthesizer: by making all systems electrically com- 
patible (as they are on the Moog and its progeny), 
any signal can be used to alter or influence any 
other signal. This is a very profound decision, 
whose far-flung results have not yet been fully ex- 
plored even among Sandin's rather fanatical stud- 
ents. 


Basically, the incoming video image is "strip- 
ped" of its synchronizing information, so that all 
signals turning up in the guts of the machine may 
be freely modified. Only at the final output stage 
are the jots and tittles of the video signal put back 
on. 


Thus the first and last blocks of the Image 
Processor act like bookends, between which the other 
modules have their fun. The first block makes the 
incoming signal into "naked" video, the last block 
dresses it up respectably again. 
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For the sake of clarity we will refer to the 
outputs as pictures, or as black, white or grey, 
which they would be if they went straight out to a 
screen; but they may be turned back into the system 
and function as inputs as well. "White" means +.5 
volts, "black" means -.5 volts. 


Let us consider, then, Sandin's modules and what 
they do individually to the brightness signal z. 
Combinations are beyond the scope of this article. 


What Dan's processor 
ean do to television 
ts not to be belteved. 


Savage colors or 
delteate off-whites, 
solarizattons and 
ptetures on top of 
ptetures. Then through 
"yideo feedback" 
(potnting a TV camera 
at a TV sereen), 

the system can generate 
throbbing animated 
cobwebs and spirals 

of tts own. Shown. 
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1. ADDER-MULTIPLIER. This combines two input 
channels, either directly or as specified by a third. 


ADDER - 
MULTIPLIER 


(regular) 
(reversed) 


CHANNEL A 
INPUTS 


CON TINVOLS — 
MULTIPLY 
INPLUt 


The channel A inputs are added together and: mul- 
tiplied by C; the channel B inputs are added together 
and multiplied by the reverse of C; both results are 
added to make the output. (NOTE: this unit is used 
among other things, for fades and keyiag.) 


2. COMPARATOR. This is like Kodalith film, mak- 
ing an image into stark black and white. Its output 
is pure black or white. One input signal (the video) 
is compared with another input signal (reference level, 
other video, whatever). 


While one is greater the output goes all black, 
and while the other is greater it goes all white. 


3. VALUE SCRAMBLER. This is a single module 
dividing the picture into eight levels. It may be 
thought of as eight of the above comparators, divid- 
ing the brightness spectrum by quantum jumps. The 
floor and ceiling of the signal to be divided are 
specified by the two control channels, but the divid- 
ing lines between them are then automatically deter- 
mined. Each corresponding output level may be con- 
trolled by a knob. 
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Thus from a range of input values, we get an 
output step-function each of whose brightnesses is in- 
dividually adjustable. 


Note that these devices may be arranged in 
parallel, thus dividing the brightness spectrum into 
as many levels as desired. 


4. OSCILLATOR MODULE (very unusual). Sandin's 
oscillators are voltage controlled, just like the ones 
in music synthesizers. However, if given any kind of 
a sync signal, they lock into the nearest multiple 
(or submultiple) within the specified range. (But 
then the control signal,if any, tweaks it higher or 


lower.) Standardized output comes in sine, square and 
sawtooth. 


OSC\LLA TOR 


The two planned uses were A) with a sync, to 
generate fixed patterns, and B) without a sync, to 
generate movable patterns. If both inputs are used, 
it becomes a stubborn lock-on voltage-controlled os- 
cillator, which tends to grab at passing submultiples. 


5. DIFFERENTIATOR. Basically this sees edges in 
the picture, or any other part of a scan-line whose 
color is changing. Its output is proportional to 


change occurring in the brightness of a scan-line, 

As the input goes from black to white its output is 
light;.as the input goes from white to black its out- 
put is dark. (The input hole selected determines the 
amount of multiplication.) 
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Diagram of how hologram ts made, p. DM 20, 
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Holography is one of those Modern Miracles 
that we really can't get into. It is mind-blowing, 
influential, and of unclear importance. 


Theoretically predicted by Dennis Gabor, the 
hologram (Greek "whole picture") was finally made 
to work in the late fifties by Leith and Upatnieks. 
Since then dozens of other types of holograms have 
been experimented with, including color holograms, 
movie holograms, video holograms, audio holograms 
and gracious know what. 


Basically a hologram is an all-around picture. 
It doesn't look like a picture, but looks like a 
smudged fingerprint or other mistake of some kind. 


Yet it is a marvel. 


A basic hologram (-- actually it should be 
called a laser hologram or Leith-Upatnieks holo- 
gram, but we've no time for such distinctions-——) 
is one of these smudgy pictures which, when viewed 
under a proper laser setup,shows you a three- 
dimensional picture. Worse than that: as you move 
your head, the picture changes correspondingly. 

It looks, not like the flat surface it is, but like 
a lit-up box with a model in it. 


What does the hologram do? Actually it re- 
creates, not a single view, but the entire tangle 
of light rays that are reflected from the real ob- 
ject. Even down to bright reflections, which 
scintillate in the usual way, as from chromium. 


The only problem: ordinarily they have to be, 
used with laser light, which is spookily one- 
colored. 


Notes from all over; art stylist Salvador Dali 
presided at an unveiling of "the world's first 360° 
hologram" at a New York gallery not long ago. The 
subject was song stylist Alice Cooper. 


The Haunted House at Disney World in Florida 
will ride you through a building full of holograms. 


That's one way to move through ghosts, all right. 


There is a New York School of Holography. 
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6. FUNCTION GENERATOR. This device is hardest to 
explain. Let's do it in terms of that first module, the 
Adder-Multiplier. Know how the Adder-Multiplier puts out 
either a positive or a negative picture, depending on 
which input you select? 


Foner ion 
GENERaTOK 


Well, the Function Generator divides the input bright- 
nesses into three ranges, and multiplies each range posi- 
tive or negative, in proportion to its own knob setting. 


Thus the combined setting of the three knobs generat- 
es a "function," or curve, from the slopes of the individ- 
ual settings. See graph. What in photography is called 
"solarization" represents just one of these combined set- 
tings. The others are nameless. 
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7. COLOR ENCODER MODULE. This is the last block. 


Into it go three signals, the desired red, blue and green; 
and out comes standard NTSC video. 


DY ELECTRONICS 


"I sing the body electric..." -- Walt Whitman 


There are various people who want to at- 
tach electronics to people's bodies and brains. 


There are basically two starting points 
for this ambition. One is authoritarian, the 
other is altruistic. I am not sure both schools 
are not equally dangerous, however. 


Let's consider first the authoritarians. 
Prof. Delgado of Yale has demonstrated that any 
creature's behavior can be controlled by jolts 
to the brain. Delgado has dealt especially with 
the negative circuits of the brain, that is, 
places where an electrical impulse causes pain 
(or "negative reinforcement"). In Delgado's 
most stunning demonstration, he stopped a char- 
ging bull with just a teeny radio signal. En- 
thusiastically Delgado tells us how fine this 
sort of thing would be for controlling Undesir- 
able Human Behavior, too. 


Now, let's consider just what we're talking 
about. In these experiments, needles are im- 
planted in the creature's brain. This can in- 
volve removing a section of the skull, or it can 
be done merely by hammering a long hollow needle 
straight into the skull and thus the brain. 


The researcher, or whatever we want to call 
him, had better know what he is doing. But due 
to the remarkable mass action of the brain, the 
destruction caused by such needles will have not 
observable effects if done properly. 


The hollow needle, once in place, becomes a 
tube for shielded electrical wires, whose bare 
metallic tips may then be used to carry little 
electrical jolts, to whatever brain tissue is 
reached by the tip of the needle, whenever tiny 
signals are applied. 


Now there are regions of the brain, distri- 
buted irregularly through its mysterious contents, 
which are loosely called the "pleasure" and 
"pain" systems. They are called that because of 
what the organism does when you jolt it in those 
places. (We do not know whether jolts to these 
areas really cause pleasure or pain, because 
these things haven't been done to human beings. 
Yet. The creatures it has been done to can't 
tell us just how it feels; thus "pleasure" and 
"pain" are in quotation marks. For now.) 


Anyway, what happens is this. If you stim- 
ulate a creature in the "pain" system it tends to 
stop what it is doing-- this is called negative 
reinforcement-- and if you stimulate it in the 
pleasure system, it tends to do more of what it 
was doing. Positive reinforcement. 


Now, to some people this suggests wonderful 
possibilities. 


Delgado, for instance, believes that this 
technology gives us everything we need for the 
control of Anti-Social Tendencies. Criminals, 
psychopaths and Bad Guys in general-- all can be 
effectively "cured" (i.e., put on their best be- 
havior) by these techniques. All we have to do, 
heh heh, is get into their heads, heh heh, habits 
of proper behavior. And with these new techniques 
of reinforcement, we can really teach ‘em. 


Unfortunately Delgado is probably right. 


In principle this is just a drastic form of 
behavior control on the B.F. Skinner model (depic- 
ted also in Nineteen Eighty-Four and A Clockwork 
Orange). The new system 1S more stark and start- 
Ting because of its violation of the individual's 
body interior, but not in principle different. 


Skinner has the same naive, simpleminded sol- 
utions for everything. All "we" have to do-- 
using "we" to mean society, the good guys, good 
guys acting on behalf of society, etc.-- is con- 
trol the behavior of the bad guys, and everything 
will be better, and "we" can accomplish anything 
"we'' desire. 


-The reader may see several problems with this. 


In the first place (and the last), there is 
the obvious question of who we are, and if we are 
going to control other people, who is going to 
control us. , 


At a time when our "highest" leaders show 
themselves preoccupied with low retaliations and 
lower initiatives, we can wonder indeed if it is 
not more important to prevent anyone from ever 
getting this kind of control over humans than to 
facilitate it. 


Even if that weren't a problem, there is the 
more simpleminded question of who in the existing 
system would use such techniques. It turns out, 
of course, that they would be added to what is 
laughably called the Correctional System, or even 


_more laughably called the Justice System. All 


the sadists you could possibly want work there. 
(And no doubt some very nice guys-- but experi- 
ments have demonstrated horrifically that decent 
people, turned into "guards" even for a short time, 
adopt the patterns of brutality we have known from 
time immemorial.) 


So, like truncheons and electric shock ther- 
apy and solitary confinement and everything else, 
these techniques-- if they are used-- will enter 
the realm of Available Punishments, not to be used 
with clinical precision but with gratuitously bru- 
talizing intent, new tools for punitivity and 
sadism. The "correctional" system would have to 
be magically corrected itself before such tools 
could be employed without simply making things 
worse. And the prospect is not good. 


Such schemes grow, of course, from a carica- 
ture of the malefactor-- thinking him to be some 
sort of miswired circuit, rather than a human being 
caught up in anger, pain, humiliation and unem- 
ployment. 


(There are also a lot of canards about Free 
Will, but these do nothing for either side in this 
controversy.) 


NEW FACULTIES 


Starting from an entirely different outlook, 
various designers and bio-engineers are trying 
to add things to the human body and nervous sys- 
tem, for the voluntary benefit of the recipient. 


A number of research and development efforts 
are aimed at helping those with sensory impair- 
ments, and electronics obviously is going to 
involved. 


An example: a firm called Listening, Inc. 

in Boston, founded by Wayne Batteau (whom John W. 
Campbell considered one of the Great Men of Our 
Time), devised a system for helping the totally 
deaf to hear. Supposedly this could transmit the 
actual sensation of hearing into the nervous sys- 
tem by some scarcely-understood form of electri- 
cal induction. The machine was sold off; whether 
it ever got a safety rating I don't know. 


This is the sort of thing people would like 
to do for the blind, as well. 


Now, in principle, it might be possible to 
transmit an image in some way to the actual vis-. 
ual area of the cerebral cortex. (This might or 
might not involve opening the skull.) Somebody's 
working on it. 


In a related trend, numerous design groups 
are attempting to extend the capabilities of the 
human body, by means of things variously called 
possums, waldoes and telefactors. 


"Possums" (from Latin "I can") are devices 
to aid the handicapped in moving, grasping and 
controlling. Whatever motions the person can 
make are electronically transposed to whatever 
realm of control is needed, such as typewriting 
or guiding a wheelchair. ("Waldo" is Heinlein's 
term for a possum that can be operated at a dis- 
tance.) 


In the space program, though, they call them 
telefactors. A telefactor is a device which con- 
verts or adapts body movements by magnification 
or remote mimicking. Unlike possums, they are 
meant to be operated by people with normal facul- 
ties, but to provide, for example, superhuman 
strength: cradled in a larger telefactor body, a 
man can pick up immense loads, as the movements 
of his arms are converted to the movements of the 
greater robot arms. 


Telefactors can also work from far, far away. 
Thus a man sitting in a booth can control, with the 
movements of his own arms, the artificial arms of 
a robot vehicle on another planet. 


(This whole realm of sensory and motor mechan- 
ics and transposition is an important aspect of 
what I call "Fantics," discussed on P p- DM 73-51). 


Then there are those who, like How Wachspress 
(see nearby), want to expand man's senses beyond 
the ordinary, into new sensory realms, by hooking 
him to various electronics. 


THOUGHTS 


There are two problems in all of this. The 
first ard worst, of course, is who controls and 
what wai: hold them back from the most evil doings. 
Recent history, both at home and abroad, suggests 
the answers are discouraging. 


The second problem, wispish and theoretical 
next to that other, is whether in turning toward 
bizarre new pleasures and involvements, we will not 
lose track of all that is human. (Of course this 
is a question that is asked by somebody whenever 
anything at all changes. But that doesn't mean it 
is always inappropriate.) 


In the face both of potential evil and dehum- 
anization, though, we can wish there were some 
boundary, some good and conspicuous stopping place 
at which to say: no further, like the three-mile 
limit in international law of old. I personally 
think it should be the human skin. Perhaps that's 
old-fashioned, being long breached by the Pace- 
maker. But what other lines can we draw? 


The prospects are horrorshow, me droogies. 


BIBLIOGRAPHY 


T.D. Sterling, E.A. Bering, Jr., S.V. Pollack 
and H. Vaughan, Jr., Visual Prosthesis: 


The Interdisciplinary Dialog. ACM 
Monograph. $21. 
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PSPCHO- ACOUSTIC DILDONICS 


I originally hadn't intended to include any- 
thing like this in the book, wanting it to be a 
family-style access catalog and all that, but this 
particular item seems fairly important. 


Remember how we laughed at the Orgasmo- 
tron in Woody Allen's Sleeper? Well, it turns 
out not to be a joke. 


An individual named How (not Howard) 
Wachspress, electronicker-in-residence at a San 
Francisco radio station, has been developing just 
that, except that he has more elevated purposes 
in mind. The secret was broken to the world 
in Oui magazine earlier this year; but Hefner, 
the publisher, evidently held back the more 
startling photographs of a model in electronically- 
induced ecstasy. 


Wachspress' devices transpose sound (as 
audio signals) into feelings; you touch your 
body with an open-ended tube or other soft 
fixture attached to his device-- which in turn 
is attached to a hi-fi. 


The sensations, it is claimed, are pro- 
found and moving. You may take them anywhere 
on your body; the effect is deeply relaxing and 
emotionally engrossing. Wachspress thinks he 
has reached an entire neurological system that 
wasn't known before, much like Olds' discovery 
of the "pleasure center" in the brain; he sees it 
as a new modality of experience and a general- 
ization of music and touch. That is the main 
point. "Hyper-reality" is where he says it gets 
you: a point curiously congruent with the author's 
own notions of hypertext and hypermedia as ex- 
tensions of the mental life. 


This said, we can consider the prurient 
aspects of Wachspress' Auditac and Teletac devi- 
ces (which he intends to market in a couple of 
years as hi-fi accessories, b'gosh). When 
played with the right audio, in the right places, 
and a good operator at the controls, they provide 
a sexual experience said to be of a high order. 


Wachspress' work ties in interestingly with 
today's "awareness" movement, of which Esalen 
is the spiritual center, which holds that we have 
gotten out of touch with our bodies, our feelings, 
our native perceptions. As such, the Wachspress 
machines may be an unfolding-mechanism for the 
unfeeling tightness of Modern Man-- as well as 
a less profound treatment for "marital difficulties" 
and Why-Can't-Johnny-Come-Lately. 


Inscrutable San Francisco! Wachspress 
gave a number of demonstrations of his devices 
in Bay Area churches, until he became disturbed 
at immodest uses of the probe by female communi- 
cants who had stood in line to try the machine. 


(Auditac, Ltd., Dept. CLB, 
1940 Washington St., 
San Francisco CA 94109.) 


Harry Mendell, a good friend of mine, rigged an 
interesting experiment while he was still in high school. 


He used a little Hewlett-Packard minicomputer, which ~ 
the manufacturer had generously loaned to his Knights of 
Columbus Computer Club of Haddonfield, N.J. 


Harry hooked the Hewlett-Packard up to a CRT display 
(see pp. 5G6-7,bM2%3)- At the top of the CRT, following 
his program, the computer continuously displayed the let- 
ters of the alphabet. A little marker (called a cursor) 
would skip along underneath the letters, acting as a mar- 
ker for each of them in turn. 


Harry rigged one more external device: a set of elec- 
trodes. These would be strapped, harmlessly, to the head 
of a subject. Harry's computer program used these elec- 
trodes to measure alpha rhythm, one of the mysterious 
pulses in the brain that come and go. 


Every time the subject flashed alpha, Harry's program 
would copy the letter above the cursor to the bottom of 
the screen. 


Sitting in this rig, subjects were able to learn, 
rather quickly, TO TYPE WORDS AND SENTENCES. Just by 
flashing alpha rhythm when the cursor was under the right 
letters. 

Jubilant, Harry showed this setup to an eminent neuro- 
physiologist from a great university nearby, a man special- 
izing in electrode hookups. Harry was a highschool student 
and did not understand about Professionalism. 


"What's so great about that?" sniffed the eminent 
professional. "I can type faster." 


So Harry dropped that and went on to other stuff. 
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PICTURE PROCESSING 


"Picture processing" is an important technology, 
largely separate from the rest of computer graphics. 
It means taking an incoming picture, usually a photo- 
graph, and doing something to it. (Some now call this 
area “computer pictorics.") 


First of all, there is image enhancement. This 
means taking pictures, dividing them into points whose 
brightness is separately measured, and then using spec- 
ial techniques for making the picture better. To 
people familiar with photography, this may seem im- 
possible; to photographers it is a maxim that photographs 
always lose quality at each step. Nevertheless, various 
mathematical techniques such as Fourier Analysis (men- 
tioned elsewhere) do just: that, producing a new data 
structure improving on the original data. Surfaces ap- 
pear smoother, edges sharper. 


(These techniques have been extensively used to 
clean up photographs sent back from our unmanned space 
vehicles-- both those used exploring other planets and 
those spying on our own-- see Secret Sentries in Space, 
Bibliography.) 


Then there are recognizers-- programs that look at 
the data structure from an input picture, and try to 
discern the lines, corners and other features of the 
picture. (While your eye instantly sees these things, 
computers do not, and must look at the dots of a picture 
one-by-one. How to analyze pictures in such tedious se- 
quences is no simple matter.) 


For recognizing more complex objects in pictures-~ 
boxes, spheres, faces or whatever~- more complex struc-— 
ture-analyzing programs are necessary. As the possibil- 
ities of what might be in a picture increase, these in- 
creasingly become guessing programs. (This becomes a 
branch of artificial intelligence, a misleading term for 
a curious field, discussed on p®"I2-lY.) 


Numerous computer people think it is important to 
match up our computer graphic display systems (described 
variously on this side of the book) to image input sys- 
tems. This is a matter of taste. 


These are all basically techniques for making a 
data structure. Any data stored in computers must have, 
of course, a data structure-—- which basically means any 
arrangement of information you choose. (see p-26-4.) 


These various techniques are intended to create re- 
duced data structures, recording only the "most impor- 
tant" data of the picture-—- from which new and varying 
pictures may be created, reflecting the "true" structures 
originally shown in the initial picture. How much it's 
going to be possible to create these data structures 
from input pictures remains to be seen} some of us think 
it's not going to be generally worthwhile. 


BIBLIOGRAPHY 


Azriel Rosenfeld, "Progress in Picture Processing 
1969-71." ACM Computing Surveys June 73, 
81-108. 


Ken Knowlton and Leon Harmon, "Computer-Produced 
Grey Scales." Computer Graphics and Image 
Processing, April 72, 1-20. 


Philip J. Klass, Secret Sentries in Space. Random, 
1971, $8. Interesting general book on geopo- 
litical strategy and orbital photoreconnais— 
sance. "Now-it-can-be-told" approach. 
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SATELLITE PICTURES OF 
YOUR OWN HOME COUNTY, 
OR WHATEVER 


You can get pictures of 
any area you want from ERTS 
(Earth Resources Observation 
Systems) satellites, from 
EROS Data Center (no, not a 
dating service, see Pp- CY); 
Sioux Falls SD 57198, or call 
605/594-6511 bet. 7 AM & PM 
central time. 
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LIZZIE OF THE LINEPRINTER 


A famous converted picture. The painting 

was divided into 100,000 brightness-measured spots 
by H. Philip Peterson of Control Data Corporation; 
then each dot was made into a square of overprinted 
letters on the printing device. The program allow- 
ed 100 levels of grey. Above: Control Data's ver- 
sion, reprinted by permission. Below: a cut-down 
version that often turns up. (From original flat 
2D artwork by Len DaVinci of Medici Associates.) 


NOTE: this is not a "computer picture." There 
is no such thing. It's a quantization put out on 
a lineprinter. 
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KEN KNONLTON 


Kenneth Knowlton is a Bell Labs lifer. 
Tall, patrician and gracious, his work, like 
Sutherland's, shows the inner light of unifying 
intelligence. He works in Max Mathews' section 
of Bell Labs at Murray Hill, where they do all 
that interesting stuff with music and perceptual 
psychology and so on. During the last decade, 
Knowlton has turned out vast quantities of art- 
icles, processed pictures, movies, and actual 
computer languages; while any ordinary man 
would be satisfied to be so productive, appar- 
ently he does a lot of other things in his work 
that he doesn't talk about. 


Some of Knowlton's best-known work 
has been in picture processing, where he has 
converted photographs into mosaics of tiny 
patterns-- which nevertheless show the original. 


His first widely-known language was 
BEFLIX (BEll Labs movie-making system); this 
was programmed for the 7094 in the early sixties. 
BEFLIX allowed the user to create motion pictures 
by a clever mosaic process that used the out- 
put camera more efficiently. (Actually, the lens 
was thrown out of focus manually and the entire 
frame created as a mosaic of alphabetical charac- 
ters; this did the whole thing much more quickly 
and inexpensively .) 


(Some of the clever data-handling tech- 
niques of BEFLIX Knowlton then turned around 
and used in L6, a language which made these 
techniques available to other computer people. 
This may sound like only a computer technicality, 
but it's the sort of thing that's widely appreciated. 
(L6 stands for "belL Labs' Lower-Level List 
Language.")) 


Wanting to get outside artists interested 
in BEFLIX and related media, he worked for a time 
with film-maker Stan Vanderbeek; from this 
Knowlton saw that artists' needs were more 
intricate than he had anticipated. Augmenting 
BEFLIX with some of the things Vanderbeek 
asked for, Knowlton came up with a new lan- 
guage called TARPS (Two-Dimensional Alpha- 
Numeric Raster Picture System). This in turn 
led to EXPLOR (EXPlicit (ly provided 2D Patterns ,) 
Local (neighborhood) Operations, and Random-' 
ness). EXPLOR is fascinating because of its 
originality and generality-- not only does it 
modify pictures and serve as an artist's tool, 
but it has fascinating properties as a computer 
language and may even have applications in 
complex simulations for technical purposes. 


Since Vanderbeek, Knowlton has entered 
into a long and fruitful collaboration with Lillian 
Schwartz, a talented artist. Their many films 
have been clever, startling and powerful. I 
must say that they grow on you: I liked them at 
first, but when I saw five or six in a row this 
January, I found them just incredible. Because 
they are abstract, and full of fast-changing 
patterns and reversals, they take some adjusting 
to; but they're worth seeing over and over. 


EXPLOR may be thought of as a highly 
generalized version of Conway's game of Life 
(see p. 4%). You start with two-dimensional 
patterns as your data structure; these can be 
abstractions or even converted photographs, as 
in a recent Knowlton-Schwartz film showing 
Muybridge's Running Man. In your EXPLOR 
program, you may then cause the pattern to 
change by degrees, each cell of the pattern 
reacting to the cells around it or to random 
events as specified by the programmer. 


EXPLOR,. running without external data, 
comes up with some extraordinary snakeskin and 
Jack Frost patterns. But its uses in traffic 
simulation and various other studies of popu- 
lations in space could be very interesting. 


EXPLOR has obvious artistic applications. 
Lillian Schwartz is using it extensively in film- 
making. It's now running on a minicomputer 
feeding to a modified Sony Trinitron color TV. 
(This color setup was created by Mike Noll 
and is described in a recent issue of the CACM, 
though only for black-and-white TV; the color 
is more recent. It stores the color picture as 
a list of sequential colors represented in the 
computer's core memory, each dot being repre- 
sented. Cf. "Boyell's Terrarium," p.9M3& .) 


Knowlton has used EXPLOR for teaching 
computer art at the University of California; 
the language is available programmed in "medium 
size" Fortran from Harry Huskey, Dept. of 
Information and Computer Science, U. of Cal. 
at Santa Cruz, Santa Cruz, California. 
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SPEECH BY COMPUTER 


You may have heard about various kinds of 
"talking computer." This deserves some explanation. 
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Computers may be made to "talk" by various 


“ Peon net oda means. One is through an output device that 

ahr erie Rata simply stores recordings of separate 

tt ‘ het i words or syllables, which the computer selects with 
“hens * WS ae rape aie appropriate timing. (Machines of this type have been 

= a Sau Apieecue pat sold by both IBM and Cognitronics for a long time.) 
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‘3 as Re Terai A peer approach is to have the computer synthe- 
eee eee avert ae pete nue size speec rom phonemes, or actually make the tones 

screen ge es eels ree fe fer shafeh 3 shams and noises of which speech is composed. These are 
Ou ae celaeqseneaen Teerer Tet 43 ee Apres aeiees reeset TA very tricky matters. Bell Labs, and others, have been 
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fhe real problem, of course, is how to decide 
what to say. (This was discussed under Artificial 
Thts ts a non-simple picture TateltAgeeees) Pome 
econverston. The original AUDIO ANALYSIS AND ENHANCEMENT 
photograph was converted tnto 
measured potnts; but these 
were in turn made tnto grow- 
together patterns by a 
program in the EXPLOR language. 
© Knowlton & Harmon. 


The problem of analyzing audio is very like the 
problem of analyzing pictures (see p.}m10), and indeed 
some of the same techniques are used. The audio goes 
into the computer as a stream of measurements, and 
the selfsame technique of Fourier Analysis is employed. 
This reduces the audio to a series of frequency measure- 
ments over time-- but, paradoxically, loses little of 
the fidelity. 


Once audio is reduced to Fourier patterns, it can 
be reconstituted in various ways: changed in timing and 
pitch independently, or enhanced by polishing techni- 
ques like those used in image enhancement (see p- dm ). 


This has been done with great success by Tom Stock- 


ham at the University of Utah, who has reprocessed old 
Caruso records into improved fidelity. In the picture 
we see him with equipment of some sort and an old record. 


Wish there were room to talk about plain 
regular audio here— matters like "binaural" 
recording, and Why don't they make hi-fi systems 
based on a Grand Bus (see p*\2 )? But there's 
no room here. & 


AUDIO AND COMPUTERS 
In the easiest case, the computer can just a 


People are occasionally still startled to send back out the voltages it originally got in. 
hear that computers can make sound and music. This is rather ridiculous-- using the computer 
They can indeed. just as a recording device-- but it's a clear and 


simple example. 
First of all, note that an incoming sound is 
a fluctuating voltage and can thus be turned into The question after that is what next: how to 
a data structure, i.e., a string of measurements. have the computer make interesting streams‘output 
measurements, i.e., sounds and tones. of 


There are numerous methods we can't go into. 
Max Mathews, at Bell Labs, has for years been doing 
music by computer; his current system is called 


hey [Wvdhoshy ng 


be chay A te GROOVE. Heinz von Foerster, at the University of 
exael measurements Illinois (Urbana), has been doing the same. An- 
(avalo ee ee Asst | comversio4) other lab at MIT has just gotten a PDP-11/45 (see 
Q p- Y2 ) for the same purpose. 
i Ce (The problem is: can the computer keep up 


te with the output rate needed to make music in real 
time? maybe the 11/45 can.) 


Another approach is to relieve the computer 
itself from making the tones, and use other de- 
vices-—- music synthesizers-- for this, controlled 
by the computer. This is essentially the approach 
taken with General Turtle's Music Box (see p. S77 ), 
and at the Columbia—Princeton Electronic Music Cen- 
ter, where their RCA Mark II music synthesizer-—- an 


immense one-of-a-kind jobbie— is under more general 
computer control. (Stockham has been in the news lately, as one of 


the panel puzzling over the notorious 18-Minute Gap.) 


Untverstty of Utah 


To make sound by computer is the obverse. If 
the computer can be set up to send out a string of 


(The author has proposed the name Kitchensynct™ 


AO ag Ve ibe i aoe igs ge iaicniaeatiaciuaiaal Sy mbolre represet shen for a system to synchronize motion pictures with "wild" 
: ~~ : oe any performance, sound recording by these means.) 
I-€., * dé notes, 
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Thomas G. Stockham, Jr., “Restoration of Old Acoustic 
, Recordings by Means of Digital Signal Processing." 
Music Audio Engineering Society preprint no. 831 (D-4), 
ay € presented at Audio Engineering Society 1971 con- 
vention. 


Spesker 
Prentiss H. Knowlton, "Capture and Display of Keyboard 

Music >| octet us Aelerofed Music," Datamation May ‘72, 56-60. Describes a 

aS ol pot devices setup he built at U. of Utah that allows pianists 

to play music on an ordinary keyboard, and converts 

the input to symbolic representation in the com- 
MUSICAL NOTATION puter. It uses an organ, a PDP-8 and a couple of 
CRT displays. 


Note that the computer handiing of musical 


notes, as symbols, is another task entirely, Heinz von Foerster and James Beauchamp, Music by Computers. 
closely resembling computer text handling (mention- Wiley, 1969. HAS RECORDS IN BACK. 
ed variously in the book). A high-power structur- 
ed-text system or Thinkertoy (see p-$m5¢5) is fine Some of the early Bell Labs work may be heard on an 
for storing and presenting written music. excellent Decca LP with the misleading title 
"MUSIC from MATHEMATICS." (Decca DL 79103). (The 
And, of course, such stored musical notation mathematical myth is discussed on p. 3-4.) 


(a data structure) can obviously be played by 
the hookups mentioned. 
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These are three topics of great importance; 
of importance, unfortunately, less for what they 
have actually accomplished than for the degree 
to which they have confused and intimidated peo- 
ple who want to understand what's going on. 
Merely to mention them can be one-upmanship. 
All three titles mean so much, so many different 
specific things, as to mean almost nothing when 
lumped together as a whole. All three have de- 
veloped a web of intricate technical facts (and 
sometimes theorems), but the applicability of 
these elegant findings is in all three cases a 
matter open to considerable scrutiny. 


Since each of these fields has developed 
a considerable body of technical doctrine, the 
reader might well ask: why aren't they on the 
other side of the book, the computer side? The 
answer is that they are computerman's dreams, 
dreams of considerable intricacy and persuas- 
iveness, and we are not considering the tech- 
nicalities here anyway. As on the other side, 
the problem is to help you distinguish apples 
from oranges and which way is up. For more 
go elsewhere, but I hope this orientation will 
make sorting things out quicker for you. 


These three terms-- "artificial intelligence," 
"information retrieval," "computer-assisted 
instruction"-- have a number of things in com- 
mon. First, the names are so portentous and 
formidable. Second, if you read or hear any- 
thing in these fields, chances are it will have 
an air of unfathomable technicality. Both strange 
technicalism and deep mathematics may combine 
to give you a sense that you can't understand 
any of it. This is wrong. The fact that there 
are obscure and Deep Teachings in each has no 
bearing on the general comprehensibility of what 
they are about. More importantly, the question 
of how applicable all the things these people 
have been doing is going to be is a question 
of considerable importance, especially when 
some of these people want to take something over. 
Don't get snowed. 


Each of these fascinating terms is actually 
a roof over a veritable zoo of different researchers, 
often of the most eccentric and interesting sort, 
each generally with his own dream of how his 
own research will be the breakthrough for 


ag SOA, 
Retrieval 


» CAI" Cranes. 
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RTIFICAL INTELLIGENCE 


. Sort of 


"Artificial Intelligence" is at once the sexiest 
and most ominous term in the world. It chills and im- 
presses at the same time. In principle it means the 
simulation of processes of mind, by any means at all; 
but it generally turns out to be some form or another 
of computer simulation (see "Simulation," p. S93). 
Actually, "artificial intelligence" has generally be- 
come an all-inclusive term for systems that amaze, as- 
tound, mystify, and do not operate according to prin- 
ciples which can be easily explained. In a way, “arti- 
ficial intelligence" is an ever-receding frontier: as 
techniques become well-worked out and understood, their 


appearance of intelligence, to the sophisticated, con- 


tinually recedes. It's like the ocean: however much 
you take out of it, it still stretches on-- as limit- 
less as before. 


Unfortunately laymen are so impressed by computers 
in general that they easily suppose computers can do 
anything involving information. And public understand- 
ing is not fostered by certain types of stupid demon- 
stration. One year I heard from numerous people about 
how "they'd seen on TV about how computers write TV 
scripts"—- what had actually been shown was a hokey en- 
actment of how the computer could randomly decide whe- 
ther the Bad Man gets shot or the Good Guy gets shot-- 
both outcomes dutifully enacted by guys in cowboy out-— 
fits. Duh. 


It should be perfectly obvious to anybody who's 
brushed even slightly with computers, however-- for 
The Brush, see the other side-- that they just don't 
work like minds. But the analogy hangs around. (Ed- 
mund C. Berkeley wrote a book in the forties, I believe, 
with the misleading title of Giant Brains, or Machines 


That Think. The idea is still around.) 


Here's a very simple example, though. Consider 
a maze drawn on a piece of paper. Just by looking, we 
cannot simultaneously comprehend all its pathways; we 
have to poke around on it to figure out the solution. 


Computers are sort of like that, but more so. While our 


eyes can take in a simple picture, like a square, at 
once, the computer program must poke around in its data 
representation at length to see what we saw at once. 


The principle holds true in general. The human 
mind can do in a flash, all at once (or “in parallel") 
many things that must be tediously checked and tried 
by the highly sequential computer program. And the 
more we know about computers, the more impressive the 
human brain becomes. (The seeming cleverness of some 
simple programs does not prove the simplicity of the 
phenomena being imitated.) 


Nevertheless, it is interesting to try things 
with computers that are more like what the mind does; 
and that is mostly what artificial intelligence is 
about. 


What it boils down to is the study of clues and 
guessing among alternatives. In some cases, well- 
defined clues can be found for recognizing specific 
things, like parts of pictures (even straight lines 
cannot be recognized by computer without a complex 
program) or like handwriting (see below). In the 
worse cases, though, careful study only raises the 
most horrendous technical problems, and the pursuit 
of these technical problems is its own field of 
study (articles have titles like "Sensitivity Para- 
meters in the Adjustment of Discriminators," meaning 
It Sure Is Hard to Draw The Line). 


But in some felicitous cases, researchers ac~ 
tually boil a recognition problem down to a manage- 
able system of clues. For instance, take the prob- 
lem of written input to computers. (Some people 
don't like to type and would rather write by hand 
on special input tablets.) But how can a program 
recognize the letters? Aha: the answer, kids, is 
in your text. 


The Ledeen Character Recognizer (described in 
detail in Newman and Sproull, Principles of Inter- 
active Computer Graphics, Appendix 8) is a method 
by which a program can look at a handedrawn charac- 
ter and try to recognize it. The program extracts 
a series of "properties" for the character and 
stores them in an array. Every character in a given 
person's block lettering will tend to have certain 
property scores. But the Ledeen recognizer must 
still be trained, that is, the average property 
scores of the letters that each individual draws 
must be put into the system before that individual's 
lettering can be recognized. Even then it's a ques~ 
tion of probability, rather than certainty, that 
a given character will be recognized. 


S ecibaia ae 


COMPUTERS DON'T ACTUALLY THINK. 


You Just THINK THEY THINK, 
(We Think.) 
\ 
eee eee 
HEURISTICS (pronounced hewRIStics) 
If we want to make a computer do what we know 
perfectly well how to do ourselves, then all we do 


is write a program. 


Aha. But what if we want a computer to do 
something we do not know how to do ourselves? 


We must set up its program to browse, and search, 
and seize on what turns out to work. 


This is called heuristics. 


What it amounts to basically is techniques for 
trying things out, checking the results, and continu- 
ing to do more and more of what seems to work. 


Or we could phrase it this way: looking for 
successful strategies in whatever area we're dealing 
with. As a heuristic program tries things out, it 


keeps various scores of how well it's doing-—- a sort of 
self-congratulation-- and makes adjustments in favor 
of what works best. 


humanity, or for something. It would take a 
Lemuel Gulliver to to show you the colorfulness 
and fascination of these fields; again, we just 
scratch the surface here. 


In various cases this has resulted in helpful 
tricks that turn out to be useful elsewhere in the 
computer field. In this sense, artificial intelligence 
is sort of like menthol: a little may improve things Thus the Greenblatt Chess Program, mentioned un- 
here and there. But (in my opinion), that does not der "Chess," nearby, can "invent" chess strategies 
mean a whole lot of it would make things better still. and "try them out"-- what it actually does is test 
specific patterns of moves for the overall goodness 
of their results (in terms of the usual positional 
advantages in chess), and discard the strategies that 
don't get anywhere. It does this by comparing its 
"strategies" (possible move patterns) against the 
records of chess matches which are fed into it. 


Another interesting thing these three fields 


uave in common: the frequent use of a classical Nevertheless, some artificial-intelligence en- 

computerman's putdown on anybody who dares thusiasts think there is no limit on what machines can 

question whether their super-ultimate goals can do. They point out that, after all, the brain is a 

ever be achieved. machine. But so is the universe, presumably; and 
we're never going to build one of those, either. 


The line is, "WE DON'T KNOW HOW TO DO 


! . 
THAT YET." (If you've read the other side of the book, 


heuristics may be thought of as a form of operations 
research (p. $Y ) carried on by the computer itself.) 


PATTERN RECOGNITION 


If somebody pulls it on you, the reply is 
simply, "How do you know you ever will?" 


ONE OF THE FEW Goon 
LAYMEN'S COMPUTER JOKES 


This is one of the most active areas in arti- 
ficial intelligence, perhaps because of Defense 
Department money. (It might be nice, goes the 
reasoning, to have guns that could recognize tanks, 
machines that could look over aerial reconnaissance 
pictures, radars that could recognize missiles...) 


In some ways heuristics is the most magical area 
of artificial intelligence: its results are the most 
impressive to laymen. But, like so many of the comput- 
er magics, it boils down to technicalities which lose 
the romance to a certain extent. 
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"The system is now ready to answer ques- 
tions," said the spokesman for the project. 


py 
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A four-star general bit off the end of a Be & ft wf 
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into the query language and typed it in. 
The machine replied: 
YES 


"Yes what?" bellowed the general. 
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The operator typed in the query. 


Came the answer: 


NEURAL SIMULATION 


An important branch of Artificial Intelligence is 
concerned with what bunches of imaginary neurons could 
do, even neurons that we made up to follow particular 
rules. This area of study is somewhere between neurol- 
ogy and mathematics; much of it is concerned with the 
mathematics of imaginary setups, rather than the proper- 
ties of actual nerve-nets, as studied by psychologists, 
physiologists and others. (The hypothetical studies, 
of course, alert researchers to complex configurations 
and possibilities that may turn out to occur in reality, 
as well as being interesting for their own sake-- and 
conceivably as useful ways of organizing things to be 
built.) 


However, an earlier myth, that you could simulate 
neurons till you got a person, is about dead. 


SIMULATION OF THOUGHT-PROCESSES 


Nobody talks anymore about simulating artificial 
brains; there's too much to it, and it involves dirty 
approximations. 


However, a cleaner area is in the simulation of 
thought: creating computer programs that mimic man's 
mental processes as he dopes through various problems. 
Trying things out, deducing thoughts from what's al- 
ready known, following through the consequences of 
guesses-- these can all be done by programs that "try 
to figure out" answers to problems like The Cannibal 
and The Missionary, or whatever. 


AUTOMATA 


"Automata", as the term is used in this field, 
is just a fancy word for imaginary critters, parti- 
cularly little thingies that behave in exact ways. 
(The Game of Life, see p. 48, is an automaton in 
this sense.) 


SELF-ORGANIZING SYSTEMS, SELF-REPRODUCING SYSTEMS, 
AND SO FORTH 


These are terms for imaginary objects, having 
exactly defined mathematical properties, about which 
various abstract things can be proven that tend to be 
of interest only to mathematicians. 


SPEECH 
1. SENTENCE GENERATION 


The problem of computers speaking human languages-—- 
not to be confused with computer languages, pp. 15-25 and 
elsewhere-- is incredibly complicated. Just because little 
human tykes start doing it effortlessly, it is easy to sup- 
pose that it's a basically easy problem. 


No way. 


Only since the mid-fifties has human language begun 
to be understood. That was when Noam Chomsky discovered the 
inner structure of human languages: namely, that the long 
(and complex) sentence constructions of language are built 
out of certain exact operations. Previous linguists had 
sought to classify the sentence structures themselves; this 
led to complexities which Chomsky discovered were unneces-— 
sary. It is unnecessary to catalog sentence types them- 
selves if we can simply isolate, instead, the exact process- 
es by which they are generated. 


These processes he called transformations (a term he 
borrowed from mathematics). All utterances are created from 
certain elementary pieces, called kernels, which are then 
chewed by transformations into surface structures, the 
final utterances. Examples of kernels: The man lives in the 
house, The house is white. Result of combining transforma- 
tion: The man lives in the white house. Kernel: I go. 
Result of past-tense transformation: I went. 


The most important finding, now, is that the transfor- 
mations are carried out in orderly sequences: any sentences 
can have more transformations carried out on it, all adher- 
ing to the basic rules, resulting in the most complex sen~- 
tences of any language. 


Linguists since then have confirmed Chomsky's con- 
jecture, and proceeded to work out the fundamental trans- 
formations of major languages, including English. 


Now, one result of all this is that it turns out to 
be easier to generate sentences in a language than to un- 
derstand them. Why? Because it is comparatively easy to 
program computers to apply transformations to kernels, 

BUT very hard to take apart the result. A complex "sur- 
face structure" may have numerous possible kernels-- does 
"Time flies like an arrow’ have the same structure as 
"Susie sings like a bird" or "Fruit flies like an orange?" 


Result: to program a computer to generate speech-—- 
that is, invent sentences about a data structure and type 
them out-- is comparatively easy, but to have it recognize 
incoming sentences, and break them up into their kernel 
meanings,is not. 


We may think of a language-generating computer sys- 
tem as follows: 


KERNEL 

SELEC IR higher 
Janavane 
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2. SENTENCE RECOGNITION 


Chomsky and others have discovered that sets of trans- 
formation rules (or grammars, praise be) vary considerably. 
It is possible to invent languages whose surface structures 
are easy to take apart, or parse; such languages are called 
context-free languages. (Most computer languages, see other 
side, are of this type.) Unfortunately natural languages, 
like English and French and Navaho, are not context~free. 
It turns out that the human brain can pick apart language 
structures because it's so good at making sensible guesses 
as to what i$ meant-- and if there is one thing hard to 
program for computers, it is sensible guessing. 
(But see "Heuristics," nearby.) 


This means that to create computer systems which will 
take real sentences apart into their meanings is quite 
difficult. We can't get into the various strategies here; 
but most researchers cut the problem down in one way or 
other. 
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“How queer!” said the yellow hen 


€, my dear?” 
55 


“Do you 


O zama-ot- Oz 


«J don’t know,’ answered Dorothy, who had 
more to read. “Listen to this, Billina:” 


DIRECTIONS FOR USING: 


For THINKING:—Wind the Clock-work Man under his 
left arm, (marked No. 1.) 


For SPEAKING:—Wind the Clock-work Man under his 


right arm, (marked No. 2.) 


For WALKING and ACTION :—Wind Clock-work in the 
middle of his back, (marked No. 3.) 


N. B—This Mechanism is guaranteed to work perfectly for a thousand years. 


«Well, I declare!” gasped the yellow hen, in 
amazement; “if the copper man can do half of these 
things he is a very wonderful machine. But] suppose 
it isall humbug, like so many other patented articles.” 

«We might wind him up,” suggested Dorothy, 
“and see what he’ll do.” 


GORDON PASK 


Gordon Pask is one of the maddest mad 
scientists I have ever met, and also one of 
the nicest. An eloquent English leprechaun 
who dresses the Edwardian dandy, Pask sows 
awe wherever he goes. A former doctor and 
theatrical producer, Pask is one of the great 
international fast-talkers, conference-hopping 
round the globe from Utah to Washington to 
his project at the Brooklyn Children's Museun. 
This spring, 1974, he has been at the Univer- 
sity of Illinois at Chicago Circle, but soon 
ne goes back to England and his laboratory. 


In a field full of brilliant eccentrics, 
Pask has no difficulty standing out. 


Pask is one of the Artificial Intelli- 
gencers who is working on teaching by compu- 
ter, about which more will be said; but the 
original core of his interest is perhaps the 
process of conceptualization and abstraction. 


Pask has done a good deal on the mathe- 
matics of self-contemplating systems, that is, 
symbolic representations of what it means for 
a creature (or entity omega) to look at things, 
see that they are alike, and divine abstract 
conceptions of them. A crowning moment is 
when Omega beholds itself and recognizes the 
continuity and selfhood. (Pask says several 
others-- scholars from Argentina, Russia and 
elsewhere-- have hit on the same formulation.) 


Models and abstraction, then, are what we 
may call the first half of Pask's work. 


Gordon Pask will be continued on p.$MY¥7- 


DM 13 


3. SPEECH OUTPUT AS SOUND 

It is possible in principle to set up computers to 
"talk" by converting the language surface structures that 
their programs come up with into actual sound. See 
"Audio," p. DM 11. 


4. SPEECH INPUT TO COMPUTERS BY ACTUAL SOUND 


So far we have been talking about the computer's mani- 
pulation of language as an alphabetical coding or similar 
representation. To actually talk at a computer is another 
kettle of fish. This means breaking down the sound into 
phonemes and then breaking it into a data structure which 
can be treated with the rules of grammar-- a whole nother 
difficult step. 


A few attempts have been made to market devices which 
would recognize limited speech and convert it to symbols to 
go into the computer. One of them, which supposedly can 
distinguish among thirty or forty different spoken words, 
is supposedly still on the market. Specific users have to 
"train" it to the particulars of their voices. 


I repeatedly hear rumors of "dictation machines" which 
will type what you say to them. If such things exist I have 
been unable to confirm it. 


(Everybody says that of course what we want is to be 
able to communicate with computers by speech. Speaking 
personally, I certainly don't. Explaining my punctuation 
to human secretaries is hard enough, let alone trying to 
tell it to a computer, when it's easy enough to type it in.) 
5. ALL TOGETHER NOW 


The complexity of the problem should by now be clear. 
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CYBERNETICS 


Gordon Pask calls his field Cybernetics. 
The term "cybernetics" is heard a lot, and is 
one of those terms which, in the main, mankind 
would be better off without; although after 
talking to Pask I get the sense that there may 
be something to it after all. 


The term ''cybernetics" was coined by Nor- 
bert Wiener, the famously absent-minded math- 
ematician who (according to legend) often 
failed to recognize his own children.’ Wiener 
did pioneering work in a number of areas. A 
special concern of his was the study of things 
which are kept in control by corrective meas- 
ures, or, as he called it, Feedback. The term 
"cybernetics" he made out of a Greek word 
for steersman, applying it to all processes 
which involve corrective control. It turns 
out that almost everything involves corrective 
control, so the term "cybernetics" spreads out 
as far and as thinly as you could possibly want 
(The public is under the general impression 
that "cybernetics" refers to computers, and 
the computer people should be called "cyber- 
neticians."" There seems to be nothing that 
can be done about this. See "cybercrud," 

p. §& . This is an even worse term meaning 
"steering people into crud," specifically, 
putting things over on people using computers.) 


Properly, the core of "cybernetics' seems 
to deal with control linkages, whether in 
automobiles, Cockroaches or Computers. How- 
ever, people like Pask, von Foerster, Ashby 
(and so on) appear to extend the concept gen- 
erally to the study of forms of behavior and 
adaptation considered in the abstract. The 
validity and fascination of this work, of 
course, is quite unrelated to what you call it. 


THE TURING MACHINE 


is the most classical abstract, Automaton. 

A Turing Machine, named after its discoverer, 
is a hypothetical device which has an infin- 
ite recording tape that it can move back and 
forth, and the ability to make decisions de~ 
pending on what's written there. 


Turing proceeded to point out that no 
matter how fast you go step-by-step, you can't 
ever outrun certain restrictions built into 
all sequential processes as represented by 
the Turing Machine. This lays heavy limits 
on what can ever be done step-by-step by 
computer. (It means we have to look for 
non-step-by-step methods, which much of 
Artificial Intelligence is about.) 
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fit the rules of acceptable input for this system. 


DO WE WANT TALKING SYSTEMS? 


I had one quite irritating experience with a 


" conversational’ system,that is, computer program 


that was supposed to talk back to me. I was sup- 
posed to type to it in English and it was supposedly 
going to type back to me in English. I found the ex- 
perience thoroughly irritating. My side of the con- 
versation, which I sincerely tried to keep simple, 
produced repeated apologies and confusion from the 
program. The guy who'd created the program kept ex- 
plaining that the program would be improved, so 

that eventually it could handle responses like mine. 
My reaction was, and is, Who needs it? 


Many people in the computer field seem to think 
we want to be able to talk to computers and have them 
talk back to us. This is by no means a settled matter. 


Talking programs are complicated and require a 
lot of space in the machine, and (more importantly) 
require a lot of time by programmers who could achieve 
(I think) more in less time by other means. Moreover, 
talking programs produce an irritating strategical 
paradox. In dealing with human beings, we know what 
we're dealing with, and can adjust what we say accord- 
ingly; there is no way to tell, except by a lot of ex- 
perimenting, what the principles are inside a particu- 
lar talking program; so that trying to adjust to it 
is a strain and an irritation. (Compare: talking to a 
stranger who may or may not turn out to be your new boss.) 
Now, some programmers keep saying that eventually they'll 
have it acting just as smart as a real person, so we needn't 
adjust; but that's ridiculous. We always adjust to real 
people. In other words, the human discomfort and irrita- 
tion of psyching the system out can never be eliminated. 


Furthermore, on today's sequential equipment and 
with feasible budgets, I personally think the likelihood 
of making programs that are really general talkers is a 
foolish goal. There are many simpler ways of telling 
computer systems what you want to tell them— light pen 
choice, for example. 


Moreover, having to type in whole English phrases 
can be irritating. (We can't even get into the problem 
of having the computer pick apart the audio if you talk 
it in.) 


This is not to say understandably restricted talking 
systems are bad. If you know and understand the sorts of 
response the system makes to what kinds of thing, then an 
English-like response is really a clear message. For in- 
stance, the JOSS system (the first Quickie language-- 
see p. 15) had an eloquent message: 


eh? 


which actually meant, What you have just typed in does not 
But it 
was short, it was quick, it was simple, and it was almost 
polite. 


Similarly, talking systems that use an exact vocabu- 
lary, whose limits and abilities are known to the person, 
are okay. (Winograd, see Bibliography, has a nice example 
of telling a computer to stack blocks, where the system 
knows words like between, on, above and so on.) Where 
this is understood by the human, it can be a genuine con- 
venience rather than a spurious one. 


(The problem of rudeness in computer dialogue has not 
been much discussed. This is partly because many program- 
mers are not fully aware of it, or, indeed, some are so 
skilled in certain subtle forms of rudeness they wouldn't 
even know they weren't acceptable. The result is that cer- 
tain types of putdown, poke, peremptoriness and importunacy 
can find their way into computer dialogue all too easily. 
Or, to put it another way: nobody like to be talked back to. 
Cf. Those stupid green THANK YOU lights on automatic toll 
booths.) 


Now, this is not to say that research in these areas 
is wrong, or even that researchers' hopes of some break- 
through in talking-systems is misguided. I am saying, 
basically, that talking systems cannot be taken for grant- 
ed as the proper goal in computers to be used by people; 
that the problems of rudeness, and irritating the human 
user, are far greater than many of these researchers sup- 
pose; and that there may be alternatives to this potential- 
ly eternal leprechaun-chasing. 


If like the author you are bemused by the great 
difficulty of getting along with human beings, then the 
creation of extraneous beings of impenetrable character 
with vaguely human qualities can only alarm you, and 
the prospect of these additional crypto-entities which 
Must be fended and placated, clawing at us from their 
niches at every turn, is both distasteful and alarming. 


Artificial Intelligence enthusiasts unfortunately 
tend to have a magician's outlook: to make clear how 
their things work would spoil the show. 


Thus, for a rather peculiar art show held at New 
York's Jewish Museum in 1970, a group from MIT built a 
large device that stacked blocks under control of a 
minicomputer (Interdata brand). Now, the fact that it 
could stack and re~stack blocks with just a minicomputer 
was really quite an accomplishment, but this was not 
explained. 


Instead, the block-stacking mechanism was enclosed 
in a large glass pen, in which numerous gerbils-- hoppy 
little rodents-- were free to wander about. When a ger- 
bil saw that a block was about to be stacked on him, he 
would sensibly move. 


Now, it is fairly humorous, and not cruel, to put 
gerbils into a block-stacking machine. But this was 
offered to the public as a device partaking of a far more 
global mission, the experimental interaction of living 
creatures and a dynamic self-improving environment, 
blah blah blah. 


Passersby were awed. "Why are those animals in 
there?” one would say, and the more informed one would 
usually say, “It's some kind of scientific experiment." 


Well, this is a twilight area, between science and 
whimsical hokum, but one cannot help wishing simple and 
humorous things could be présented with their simplicity 
and humor laid bare. 


I remember watching one gerbil who stood motionless 
on his little kangaroo matchstick legs, watching the Great 
Grappler rearranging his world. Gerbils are somewhat in- 
scrutable, but I had a sense that he was worshiping it. 

He did not move until the block started coming down on top 
of him. 


I take this as an allegory. 


CAN A COMPUTER PLAY CHESS? 


The real question is, can a set of procedures 
play chess? Because that's what the computer pro- 
gram really does, enact a set of procedures. 


And the answer is yes, fairly well. 


Now, a chess program is not something you jot 
down on the back of an envelope one afternoon. It's 
usually an immense, convoluted thing that people have 
worked on for years. (Although I vaguely recall that 
second place in the 1970 inter-computer chess contest 
was won by a program that occupied only 2000 locations 
in a 16-bit minicomputer-—- in other words, a compact 
and tricky sneaker.) 


Now, simple games (like tic-tac-toe and Nim and 
even Cubic) can be worked out all the way: all alter- 
natives can be examined by the program and the best 
one found. Not so with chess. 


Chess basically involves, because of its very 
many possibilities, a "combinatorial explosion" of 
alternatives (see p. 45): that is, to look at "all" 
the possibilities of a midgame would take forever 
(perhaps literally-- the Turing problem), and thus 
means must be found for discarding some possibilities. 


The structure of branching possibilities is a 
tree (see p. 2); so that methods of “pruning" the 
tree turn out to be crucial. 


Basically there are two approaches to the design 
of chess programs. In one approach, the programmers 
‘look for specific threats and opportunities in the 
data structure representing the board, and try to find 
good strategies for selecting good moves on the basis 
of them. This is the approach taken in COKO, the 
"Cooper-Koz"chess program. The programmers selectively 
cope with individual problems and strategies as they 
turn out to be necessary. (This means that it is 
likely to have specific Achilles' heels; which, of 
course, the authors of the program keep trying to re- 
pair by adding specific corrections.) 


A different approach is taken by the Greenblatt 
chess program. This is basically a big Heuristic prog- 
ram. It “learns'" best strategies in chess by "watching" 
the game. That is, your pour historical chess matches 
through it, and it tries out strategies-- making various 
tentative rules about what kinds of moves are good, then 
scoring these moves according to the results of making 
them-- as seen in positional advantages that resulted in 
actually championship play. 


Obviously this is a field in itself, You won't get 
grants for it, but to those who really care about both 
chess and computers, it's the only thing to be doing. 


FRANKENSTEIN MEETS CYBERCRUD 


Fred Brooks, the keynote speaker at the IEEE com- 
puter conference in Fall 74, seems to have said that 
HAL 9000 (the unctuous, traitorous Presence in the 
movie 2001) was the way computers should be. (Computer 
Decisions, Apr 74, 4.) 


I find it hard to believe that anybody could think 
that. Nevertheless, there are those artificial-intelli- 
gence freaks whose view it is that the purpose of all 
this is eventually (a) to create servants that will read 
our minds and do our bidding, (b) servants who will take 
things over and will implement human morality, regardless 
of our bidding (though we humans are toofrail to do so-- 
as in Asimov's I, Robot); or even (c) create masters who 
will take everything over and run everything according to 
their own principles and the hell with us. (I met a man 
in a bar, after an ACM meeting, who claimed to believe 
this was the purpose of it all: to create the master race 
that would replace us. ) 


Clarke's retroactive novel 
(Signet, 1968, 95¢), the HAL 9000 
egan as follows: 


According to Arthur C. 
2002 A'S Space Odysse 
fia teas ane series 


"In the 1980s, Minsky and Good had shown how neural 
networks could be generated automatically-- self- 
replicated-- in accordance with any arbitrary 
learning pattern. Artificial brains could be grown 
by a process strikingly analogous to the development 
of the human brain." (P. 96.) 


I don't know who Good is, but these are among the lines 
Minsky has been working along for years, so I hope he's 
encouraged by the news of what he's going to accomplish. 


Anyhow, so okay they grow the HAL 9000 in a tank. 
Then how come in the Death-of-Hal scene we see Keir Dullea 
bobbing around loosening circuit cards, just as if it 
were a plain old 1978 computer? 


Possible answer #1. It is rumored that Clarke's 
retro-novel was Clarke's rebuttal to Kubrick's final film. 


Possible answer #2. HAL's tanks of neural glop are 
controlled by PDP-1lls, one to a card. 


(Of course, if you take the letters after H, A and L 
in the alphabet, you get I, B and M. 
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DEUS EX MACHINA 


Obviously such beliefs are outside the realm of 
science or engineering. They belong to pure speculation; 
and while various mechanisms have in fact been programmed 
to croak, stagger, stack blocks, compose sentences and so 
on, to suppose that we are in any real sense anywhere near 
mimicking human intelligence, let alone surpassing and 
superseding it, is either to be totally fooled or to hanker 
after some curious dream from inside yourself. 


As we said on the other side of the book, everybody in 
computers has deeper motivations and interior twists that 
form his own special ties to these machines; and when it 
comes to our choices of fantasy machines, obviously an even 
deeper level of psychic imprint is projecting itself into 
the world. 


-..EX MENSA 


People who fantasize about wondrous creatures and deities they 
want to make out of the computer obviously have something in- 
teresting in their own heads from which that comes. Perhaps 
it comes from a desire for imaginary playmates, or an ambi- 
valence toward authority, or goodness knows what; there are so 
many odd people at different ends of Artificial Intelligence 
that there may be a lot of different psychological systems 

at work. Or maybe artificial intelligence is just where the 
Most brilliant, determined and eccentric dreamers go. Anyway, 
I can only ask the cvestion, not give the answer. 


So maybe those are 1130s.) 


THE THREE LAWS OF ROBOTICS 


1-- A robot may not injure a human being, or, 
through inaction, allow a human being to come 
to harm. 


1-- A robot must obey the orders given it by 
human beings except where such orders would 
conflict with the First Law. 


3-- A robot must protect its own existence as 
long as such protection does not conflict with 
the First or Second Law. 


-- Handbook of Robotics, 
56th Edition, 2058 A.D., 
quoted in I. Asimov, I, Robot. 
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ELIZA WILL Ste YOU Nou 


(What the ELIZA program types, we represent as all caps; 
what the person types is not.) 


PLEASE TELL ME YOUR PROBLEM. 
I am feeling depressed. 
HOW LONG HAVE YOU BEEN FEELING DEPRESSED? 
Ever since my mother left. 
TELL ME MORE ABOUT YOUR FAMILY. 
My father is very strict. 
PLEASE GO ON. 
Last night I dreamt he spanked me. 
WHAT WOULD IT MEAN TO YOU IF HE SPANKED YOU? 
Didn't you ever get spanked? 
WE WERE DISCUSSING YOU, NOT ME. 
You're just a dumb machine anyway. 
DO COMPUTERS FRIGHTEN YOU? 
(quoted in Winograd, 74-5) 


The fascinating thing about the ELIZA program is 
that it seems so like a real person-- that is, a psycho- 
analyst of the nondirective, Carl Rogers school. 


But all it is is a bag of tricks. 


It has a lot of canned phrases it can throw out, 
like PLEASE TELL ME YOUR PROBLEM. 


Then it spots certain types of sentences and turns 
them around. If the person types a sentence beginning with 
"I am...", the ELIZA program turns it around with HOW LONG 


HAVE YOUR BEEN... ? 


And it looks for specific words which indicate a sen- 
tence can be turned around for a convincing result. For in- 
stance, if the person uses the word “everyone," the program 
simply replies, WHO IN PARTICULAR CAN YOU THINK OF? 


And certain highly-charged words are signals to throw in 
a zinger, regardless of what the user may have said. For in- 
stance, if the person uses the word "mother," the machine 
replies: 


TELL ME ABOUT YOUR FAMILY. 


Now, do not be fooled. There is no Ghost in the 


Machine. The program does not "understand" the user. 


THE PROGRAM IS MERELY ACTING OUT THE BAG OF TRICKS THAT 
JOE WEIZENBAUM THOUGHT UP. Credit where credit is due: 
not to The Computer's Omniscience, but to Weizenbaum's 

cleverness. 


(Look at the above sample dialogue and see if you 
guess what tricks the program was using.) 


The thing is, many people refuse to believe that it's 
a program. Even when the program's tricks are explained. 


And even some who understand ELIZA like to call it up 
from their terminals for companionship, now and then. 


BIBLIOGRAPHY 
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(Weizenbaum's full article on ELIZA appeared in the 
Communications of the ACM sometime in the mid or 
late sixties; a flowchart revealed its major tricks. 


I have strong hunches about the inner work- 
ings of men who get millions of dollars from the 
Department of Defense and then say in private 
that really they're going to use it to create a 
machine so intelligent it can play with their chil- 
dren. (Not to name names or anything.) An 
obvious question is, do they play with their 
children? No, they play with computers. 


But the point here is not to hassle the 
dreamers, just to sort out the dreams and put 
them on hangers so you can try them on, and 
maybe choose an ensemble for yourself. 
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INFORMATION RETRIEVAL 


"Information Retrieval" is one of those terms 
that laymen throw around as if it were a manhole 
cover. It sounds as though it means so much, so very’ 
much. And so you actually hear people say things like: 
"But that would mean... (pregnant pause) ... Informa- 
tion Retrieval!!!" Similarly, some of the hokey new 
copyright notices you see in books from With-It publish- 
ers intone that said books may not be “place{in any in- 
formation retrieval system..."" I take this to mean 
that the publishers are forbidding you to put the book 
on a bookshelf, because “information retrieval" simply 
means any way at all of getting back information from 
anything. A bookshelf, since it allows you to read the 
spines of the books, is indeed an Information Retrieval 
System. 


It happens, incidentally, that the phrase "informa- 
tion retrieval" was coined in the forties by Calvin Mooers, 
inventor of TRACt™ Language (see pp. 18-21). (If Wiener 
had coined it he might have called it Getback. If Diebold 
had coined it it might have been Thoughtomation.) 


Anyhow, numerous entirely different things go on in 
the field, all under the name of Information Retrieval. 
Here are some. 


1. Nonrcomputer retrieval. (See Becker and Hayes, 
Automatic Information Retrieval.) These things are kind 
of old-fashioned fun-- cards with holes punched along the 
edge, for instance,that you sort with knitting needles, 
or the more recent systems with holes drilled in plastic 
cards. Trouble is, of course, that computers are becoming 
much more convenient and even less expensive than these, 
counting your own time as being worth something. 


2. Document Retrieval. This basically is an approach 
that glorifies the old library card file, except now the 
stuff is stored in computers rather than on cards. But 
what's stored is still the name of the document, who wrote 
it, where it was published and so on. Obviously helpful 
to librarians, but scarcely exciting. 


3. Automatic document indexing. Some organizations 
find it helpful to have a computer try to figure out what 
a book is about, rather than have a person look at it and 
check. (I don't see why this saves anything, but there you 
are.) Anyway, the text of the document (or selected parts) 
are poured through a computer program that selects, for in- 
stance, keywords, that is, the most important words in it, 
or rather words the program thinks are most important. Then 
these keywords can go on the headings of library file cards, 
or whatever. 


There are various related systems by which people 
study, for instance, the citations between articles, but 
we won't get into that. 


4. Content retrieval. Now we're getting to the sexy 
stuff. A system for content retrieval is one that somehow 
stores information in a computer and lets you get it back 
out. 


The trick on both counts is of course how. 


Well, as we said on the other side of the book, any 
information stored in a computer has a data structure, 
which simply means whatever arrangement of alphabetical 
characters, numbers and special codes the computer happens 
to be saving. 


In a content~-retrieval system, information on some 
subject is somehow jammed into a data structure-- possibly 
even by human coders-- and then set up so people can get 
it back out again in some way. Lot of possibilities here, 
get it? 
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In the most startling of these systems, the QAS, or 
"“Question-Answering System," some sort of dialogue program 
(see "Artificial Intelligence," nearby) tries to give you 
answers about the data structure. But this means there 
have to be a whole lot of programs: 
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These systems can be quite startling in the- way 
they seem to understand you (see Licklider book; also 


Winograd piece under Artificial Intelligence). But they 
don't understand you. They are just poor dumb programs. 


Many people (including Licklider) seem to see in 
,Question~Answering~Systems the wave of the future. 
Others, like this author, are skeptical. It's one thing 
to have a system that can deduce that Green's House is 
West of Red's House from a bunch of input sentences on 
the subject, but the question of how much these can be 
improved is in some doubt. A system that can answer the 
question, "What did Hegel say about determinism?" is 
Some ways away, to put it mildly. 


All these things 
are very technical. 


The reader 
must decide 
for himself 
which, 

if any, 

are misguided. 


Then there is the matter of consistency. The really 
interesting subjects are the ones where different authors 
claim opposing facts to support opposite conclusions. 

In other words, there is inconsistency within the content 
of the field. In this case such systems are going to have 
a problem. (See "Rasho-Mon Principle" under "Tissue of 


Thought," pp. DM 16-I 1, 


Another fundamental point is this. It may be easy 
enough to program a system to answer the question, 


WHAT TIME DOES THE NEXT PLANE LEAVE FOR LAGUARDIA? 


: hove it 
but it is a lot simpler to,display schedules your eye can 
run down, or allow you to go look at some kind of graphic 
display. 


Speaking personally, I don't like talking to machines 
and I don't like their talking back to me. I'm not saying 
you have to agree, I'm just telling you you're allowed to 
feel that way. 


5. Screen summaries. These systems let you sit at 
a computer display screen and read summaries of various 
things, as well as run through them with various programs 
to look for keywords. (The New York Times now offers such 
a system, costing over a thousand dollars a month to sub- 
scribers.) 


6. "Full-text systems." These are systems that 
one way or another allow you to read all the text of 
something from a computet display screen. There are 
those of us who see these as the wave of the future, 
but many others are perfectly outraged at the thought. 
(Hypertext systems, now, are setups that allow you to 
read interconnected texts from computer display screens. 
See Sak eye 

BP 7.) 


This has been brief and has skipped a lot. 
as you see,IR is no one thing. 


Anyway , 
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Whatever its other merits, this book is great 


for shaking people up, especially librarians. It 
seems so official. 
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It is a truism that Mendel's theories of 
genetics got 'lost'' after publication in 
1865, to be rediscovered in 1900. "If 
only there had been proper information 
retrieval under the right categories,'' 
people often say. Recent studies indi- 
cate that the publication containing 
Mendel's paper reached, or got nearly to, 
"practically all prominent biologists of 
the mid-nineteenth century.'' (Scientific 
American, July 68, 55.) 


1 take this as suggesting that the prob- 
lem isn't categorical retrieval at all. 
It's multi-connected availability (see 


"hypertext ,'' pp tym 4-7. 
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COMPUTER-ASCISTED INSTRUCTION 


Like Artificial Intelligence and Information Ret- 
rieval, Computer-Assisted Instruction sounds like some- 
thing exact and impressive but is in fact a scattering of 
techniques tied together only nominally by a general idea. 


The real name for it should be Automated Dialogue 
Teaching. That would immediately allow you to ask, should 
computer teaching use dialogues? But they don't want you 
to ask that. 


In the classic formulation of the early sixties, there 
were going to be three levels of CAI: "drill-and-practice" 
systems, much like teaching machines, that simply helped 
students practice various skills; a middle level (often 
itself called, confusingly, “computer-assisted instruction"); 


.and a third level, the Socratic system, which would supposedly 


be Ideal. Students studying on Socratic systems would be 
eloquently and thoughtfully instructed and corrected by a 
perfect being in the machine. '"We don't know how to do that 
yet," the people keep saying. Yet, indeed. 


(My personal view on this subject, expressed in an article 
(following) is that Computer-Assisted Instruction in many 
ways extends the worst features of education as we now know it 
into the new realm of presentation by computer.) 


DOES THE NAME PAVLOV 
RING A Bece? 


This is a true story. (The details are approx- 
imate.) It may provide certain insights. 


An Assistant Commissioner of Education was 
being shown a CAI system by representatives of a 
large and well-known computer company. 


One one side of the Commissioner stood a sales~ 
man, who wanted him to be impressed. On the other 
side stood one Dr. S., who knew how the system 
worked. 


The terminal, demonstrating a history program 
that had hurriedly been put together, typed: WHO 
CAPTURED FORT TICONDEROGA? 


"Can | type anything?'! asked the Assistant 
Commissioner. 


"Sure,'' said the salesman, ignoring the frantic 
head-shaking of Dr. S. 


The Assistant Commissioner typed: Gypsy Rose 
Lee. 


The machine replied: 


NO, BUT YOU'RE CLOSE. HE CAPTURED QUEBEC A 


SHORT TIME LATER. 
The Assistant Commissioner evidently enlivened 
many a luncheon with that one, and Computer-Assisted 


Instruction was effectively dead for the rest of the 
administration. 
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ANOTHER ANECDOTE 


Some of us have been saying for a long time 
that learning from computers ought to be 
under control of the student. 


One group (never mind who) has taken hold 
of this idea and gotten a lot of funding 
for it under the name of STUDENT CONTROL. 
This group talks as if it were some kind of 
scientific breakthrough. 


A friend of mine suggests, however, that 
this phrase may have brought the funding 
because administrators thought it meant 
control of the student. 
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(The following article appeared in the September, 1970 issue of Computer Decisions, 
and got an extraordinary amount of attention. I have changed my views somewhat-- 
we all go through changes, after all-- but after consideration have decided to re-run 
it in the original form, without qualifications, mollifications or anything, for its unity. 
Thanks to Computer Decisions for use of the artwork by Gans and for the Superstudent 
picture on the cover, whose artist unfortunately insists on preserving his anonymity. 


by Theodor H. Nelson 
The Nelson Organization 
New York 

Some think the educational system is basically 
all right, and more resources would get it working 
again. Schools would do things the same way, ex- 
cept more so, and things would get better. 

In that case the obvious question would be, how 
can computers help? How can computers usefully 
supplement and extend the traditional and accept- 
ed forms of teaching? This is the question to which 
present-day efforts in “computer-assisted instruc- 
tion” — called CAI — seem to respond. 

But such an approach is of no possible interest 
to the new generation of critics of our school sys- 
tem —- people like John Holt (Why Children Fail), 
Jonathan Kozol (Death at an Early Age) and 
James Herndon (The Way It Spozed To Be). More 


No MORE TEAC 


and more, such people are severely questioning the 
general framework and structure of the way we 
teach. 

These writers describe particularly ghastly 
examples of our schooling conditions. But such 
horror stories aside, we are coming to recognize 


Did you find school dismal and dreary? that schools as we know them appear designed at 
Did it turn you off? every level to sabotage the supposed goals of edu- 


Here the author proposes safe and legal cation. A child arrives at school bright and early 


in his life. By drabness we deprive him of interests. 
By fixed curriculum and sequence we rob him of 
his orientation, initiative and motivation, and by 
testing and scoring we subvert his natural intelli- 
gence. 


ways to turn kids on. 


Schools as we know them all run on the same 
principles: iron all subjects flat and then proceed, 
in groups, at a forced march across the flattened 
plain. Material is dumped on the students and their 
responses calibrated; their interaction and involve- 
ment with the material is not encouraged nor taken 
into consideration, but their dutifulness of response 
is carefully monitored. 

While an exact arrangement of intended motiva- 
tions for the student is preset within the system, 
they do not usually take effect according to the 
ideal. It is not that students are unmotivated, but 
motivated askew. Rather than seek to achieve in 
the way they are supposed to, students turn to 
churlishness, surliness, or intellectual sheepishness. 
A general human motivation is god-given at the 
beginning and warped or destroyed by the edu- 
cational process as we know it; thus we internalize 
at last that most fundamental of grownup goals: 
just to get through another day. 

Because of this procedure our very notion of 
human ability has suffered. Adult mentality is 
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An interesting point, incidentally, is that people read this a lot of different ways. 
One Dean of Education hilariously misread it as an across-the-board plug for CAI. 
Others read in it various forms of menace or advocacy of generalized mechanization. 
One letter-writer said I was a menace but at least writing articles kept me off the 


cauterized, and we call it “normal.” Most people’s 
minds are mostly turned off most of the time. We 
know virtually nothing of human abilities except 
as they have been pickled and boxed in schools; we 
need to ignore all that and start fresh. To want stu- 
dents to be “normal” is criminal, when we are all 
so far below our potential. Buckminster Fuller, in 
I! Seem To Be A Verb, says we are all born ge- 
niuses; Sylvia Ashton-Warner tells us in Teacher 
of her success with this premise, and of the bril- 
liance and creative potential she was able to find in 
all her schoolchildren. 

Curricula themselves destructively arrange the 
study situation. By walls between artificially segre- 
gated “studies” and “separate topics” we forbid the 
pursuit of interest and kill motivation. 

In ordinary schooling, the victim cannot orient 
himself to the current topic except by understand- 
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ing the official angle of approach and _presenta- 
tion. Though tie-ins to previous interests and 
knowledge are usually the best way to get an initial 
sense of a thing, there is only time to consider the 
officially presented tie-ins. (Neither is there time 
to answer questions, except briefly and rarely well sy : = 
~ und usually in a way that promotes “order” by 1 the computer is a universal control system, 
ene extraneous” Ue-ins from coming UP-) Jet's give kids universes to control. 
le unnecessary division and walling of sub- 
jects, sequencing and kibbling of material lead peo- 
ple to expect simplifications, to feel that naming a 
thing is understanding it, to fear complex wholes; 
to believe creativity means recombination, the 
parsing of old relations, rather than’ synthesis. 
Like political boundaries, curriculum boundar- 
les arise from noticeable features of a continuum 
and become progressively more fortified. As be- 
hind political borders, social unification occurs 
within them, so that wholly dissimilar practitioners 
who share a name come to think they do the same 
thing. And because they talk mainly to each other, 
they forget how near is the other side of the border. 
Because of the fiction of “subjects,” great con- 
cern and consideration has always gone into cal- 
culating the “correct” teaching sequence for each 
“subject.” In recent years radical new teaching se- 
quences have been introduced for teaching various 
subjects. including mathematics and physics. But 
such efforts appear to have been misinformed by 
the idea of supplanting the “wrong” teaching se- 
quence with the “right” teaching sequence, one 
which 1s “validated.” Similarly, we have gone from 
a time when the instructional sequence was a bal- 
ance between tradition and the lowest common de- 
nominator of each subject. to a time when teachers 
may pick “flexible optimized strategies” from text- 
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Some premises relevant to teaching 


- 

* 

* 

. The human mind is born free, yet everywhere 

:s it is in chains. The educational system serves 

mainly to destroy for most people, in varying 
degrees, intelligence, curiosity, enthusiasm, and 
intellectual initiative and self-confidence. We 
‘are born with these. They are gone or severely 
diminished when we leave school. 

2. Everything is interesting, until ruined for us. 
Nothing in the universe is intrinsically unin- 
teresting. Schooling systematically ruins things 
for us, wiping out these interests; the last thing 
to be ruined determines your profession. 

3. There are no “subjects.” The division of the 
universe into “subjects” for teaching is a mat- 
ter of tradition and administrative convenience. 

4. There is no natural or necessary order of 
learning. Teaching sequences are arbitrary, 
explanatory hierarchies philosophically spuri- 
ous. “Prerequisites” are a fiction spawned by 
the division of the world into “subjects;” and 

maintained by not providing summaries, intro- 

ductions or orientational materials except to 
those arriving through a certain door. 

5. Anyone retaining his natural mental facilities . 

can learn anything practically on his own, 

given encouragement and resources. 

6. Most teachers mean well, but they are so 
concerned with promoting their images, atti- 
tudes and style of order that very little else 
can be communicated in the time remaining, 
and almost none of it attractively. 
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books.! And this all ignores a simple fact: all are 
arbitrary. Instructional sequences aren’t needed at all 
if the people are motivated and the materials are clear 
and available. 

Testing as we know it (integrated with walled curric- 
ula and instructional sequences) is a destructive activ- 
ity, particularly for the orientation which it creates. 
The concerns of testing are extraneous: learning to 
figure out low-level twists in questions that lead no- 
where, under pressure. 

The system of tensions and defenses it creates in the 
student’s personality are unrelated to the subject or 
the way people might relate to the subject. An exploit- 
ive attitude is fostered. Not becoming involved with 
the subject, the student grabs for rote payoff rather 
than insight. 

All in a condescending circumstance. Condescension 
is built into the system at all levels, so pervasive it is 
scarcely noticed. Students are subjected to a grim 
variety of put-downs and denigrations. While many 
people evidently believe this to be right, its productivity 
in building confident and self-respecting minds may be 
doubted. 

The problems of the school are not particularly the 
teacher’s fault. The practice of teaching is principally 
involved with managing the class, keeping up face, and 
projecting the image of the subject that conforms to the 
teacher’s own predilections. The cducational system is 
thereby committed to the fussy and prissy, to the en- 
forcement of peculiar standards of righteousness and 
the elevation of teachers—a huge irrelevant shell 
around the small kernel of knowledge transmitted. 

The usual attacks on computer teaching tend to be 
sentimental and emotional pleas for the alleged hu- 
manism of the existing system. Those who are opposed 
to the use of computers to teach generally believe the 
computer to be “cold” and “inhuman.” The teacher 
is considered “warm” and “human.” This vicw is ques- 
tionable on both sides. 

The computer is as inhuman as we make it. The 
computer is no more “cold” and “inhuman” than a 
toaster, bathtub or automobile (all associated with 
warm human activities). Living teachers can be as in- 
human as members of any people-prodding profession, 
sometimes more so. Computerists speak of “freeing 
teachers for the creative part of their work,” in many 
cases it is not clear what creative tasks they could be 
freed for. 

At the last, it is to rescue the student from the in- 
human teacher, and allow him to relate directly and 
personally to the intrinsically interesting subject mat- 
ter, that we need to use computers in cducation. 

Many successful systems of teacherless learning exist 
in our society: professional and industrial magazines, 
conventions and their display booths and brochures; 
technical sales pitches (most remarkably, those of med- 
ical “detail men”); hobbyist circles, which combine 
personal acquaintance with a round of magazines and 


gatherings; think-tanks and research institutes, where. 


specialists trade fields; and the respectful bricfing. 

None of these is like the conventional classroom 
with its haughty resource-chairman, they are not run 
on condescension; and they get a lot across. We tend 
to think they are not “education” and that the methods 
cannot be transferred or extended to the regions now 
ruled by conventional teaching. But why not?. _ 
If everything we “ate were kibbled into uniform dog- 
food, and the amount consumed at each feeding time 
tediously watched and tested, we would have little 
fondness for eating. But this is what the schools do to 
our food for thought, and this is what happens to 
people’s minds in primary school, secondary school 
and most colleges. 

This is the way to produce a nation “of sheep or 


clerks. If we are serious about wanting people to have. 


creative and energetic minds, it is not what we ought 
to do. Energy and enthusiasm are natural to the human 
spirit, why drown them? 
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Education ought to be clear, inviting and enjoyable, 
without booby-traps, humiliations, condescension or 
boredom. It ought to teach and reward initiative, curi- 
osity, the habit of self-motivation, intellectual involve- 
ment. Students should develop, through practice, abili- 
ties to think, argue and disagree intelligently. 

Educators and computer enthusiasts tend to agree on 
these goals. But what happens? Many of the inhuman- 
ities of the existing system, no Iess wrong for being 
unitentional, are being continued into computer-assist- 
ed teaching. 

Although the promoters of computer-assisted instruc- 
tion, affectionately called “cal,” seem to think of them- 
selves as being at the vanguard of progress in all di- 


rections, the field already seems to operate according 
‘o a stereotype. We may call this “classic” or “‘conven- 
ional” CAI, a way of thinking depressingly summarized 
n “The Use of Computers in Education” by Patrick 
juppes, Scientific American, September, 1966, 206- 
220, an article of semi-classic stature. 

It is an unexamined premise of this article that the 
computer system will always decide what the student 
is to study and control his movements through it. The 
student is to be led by the nose through every subject, 
and the author expresses perplexity over the question 
of how the system can decide, at all times, where to 
lead the student by the nose (top of col. 3, p. 219). 
But let us not anticipate alternatives. 

It is often asserted (as by Alpert and Bitzer in “Ad- 
vances in Computer-Based Education,” Science, 
March 20, 1970) that this is not the only approach 
current. The trouble is that it seems to be the only ap- 
proach current, and in the expanding computer uni- 
verse everyone seems to know what cal “‘is.” And this 
Is It. 

Computer-assisted instruction, in this classical sense, 
is the presentation by computer of bite-sized segments 
of instructional material, branching among them ac- 
cording to involuntary choices by the student (‘‘an 
swers”) and embedding material presented the student 
in some sort of pseudo-conversation (“Very good. 
Now, Johnny, point at the. . .”) 


CAI: Based on unnecessary premises 


_At whichever level of complexity, all these conven- 
tional CAI systems are based on three premises: that 
all presentations consists of items, short chunks and 
questions; that the items are arranged into sequences, 
though these sequences may branch and vary under 
control of the computer; and finally, that these sequen- 
ces are to be embedded in a framework of dialogue; 
with the computer composing sentences and questions 
appropriately based on the student’s input and the 
branching structure of the materials. Let us call such 
systems sic (Sequenced-Item Conversational) systems. 

These three premises are united. For there to be 
dialogue means there must be an underlying graph 
structure of potential sequences around which dialogue 
may be generated; for there to be potential sequences 
means breakpoints, and hence items. 

Let us question each of the premises in turn. 

1. Is dialogue pleasant or desirable? Compulsory 
interaction, whether with a talking machine or a stereo- 
typed human, is itself a put-down or condescension. 
(Note that on superhighways there is often a line of 
cars behind the automatic ‘toll booths, even when the 
manned ones are open.) Moreover, faked interaction 
can be an annoyance. (Consider the green light at the 
automatic toll booth that lights up with a “thank you.”) 
Moreover, dialogue by simple systems tends to have a 
fake quality. It is by no means obvious that phony 
dialogue with a machine will please the student. 

2. Is the item approach necessary? If the student 
were in control, he could move around in areas of 
material, leaving each scene when he got what he want- 
ed, or found it unhelpful. 

3. Are sequences necessary? Prearranged sequences 
become unnecessary if the student can see what he has 
yet to learn, then pursue it. 


The sense ot prestige and participation 


CAI: unnecessary complication 

The general belief among practitioners is that ma- 
terials for computer-based teaching are extremely dif- 
ficult to create, or “program.” Because of possible 
item weakness and the great variety of possible se- 
quences within the web, extensive experimentation and 
debugging are required. Each item must be carefully 
proven; and the different sequences open to a student 
must all be tested for their effectiveness. All possible 
misunderstandings by a student need to be anticipated 
and prevented in this web of sequences, which must be 
designed for its coverage, correct order, and general 
effectiveness. 


CAI: general wrongfulness 


Computers offer us the first real chance to let the 
human mind grow to its full potential, as it cannot 
within the stifling and insulting setting of existing 
school systems. Yet most of the systems for computer- 
assisted instruction seem to me to be perpetuating and 
endorsing much that is wrong, even evil, in our present 
educational system. CAI in its conventional form en- 
larges and extends the faults of the American educa- 
tional system itself. They are: 


© Conduciveness to boredom; 

e The removal of opportunities for initiative; 

® Gratuitous concerns, both social and administra- 
tive (“‘subject,” “progress” in subject); 

¢ Grades, which really reflect commitment level, 
anxiety, and willingness to focus on core emphasis; 

¢ Stereotyped and condescending treatment of the 
student (the “Now-Johnny” box in the computer re- 
placing the one that sits before the class); 

e The narrowing of curricula and available materials 
for “results” at the expense of motivation and general- 
ized orientation; 

e Destructive testing of a kind we would not permit 
on delicate machinery; and, 

e An overt or hidden emphasis on invidious ratings. 
(Ungraded schools are nice—but how many units did 
you complete today?). 

There are of course improvements, for instance in 
the effects of testing. In the tell-test, tell-test nattering 
of CAI, the testing becomes merely an irritant, but one 
certainly not likely to foster enthusiasm. 
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But isn’t CAI ‘scientific?’ 

Part of Cal’s mystique is based upon the idea that 
teaching can become “scientific” in the light of modern 
research, especially learning theory. It is understand- 
able that researchers should promote this view and 
that others should fall for it. 

Laymen do not understand, nor are they told, that 
“learning theory” is an extremely technical, mathemat- 
ically oriented, description of the behavior of abstract 
and idealized organisms learning non-unified things 
under specific conditions of motivation and non-dis- 
traction. 

Let us assume, politely, that learning theory Is a 
full and consistent body of knowledge. Because of its 
name, learning theory has at least what we may call 
nominal relevance to teaching; but real relevance is 
another matter. It may be relevant as Newtonian cqua- 
tions are to shooting a good game of pool: implicit but 
without practical bearing. 

Because of the actual character of learning theory, 
and its general remoteness from non-sterile conditions, 
actual relevance to any particular type of application 
must still be demonstrated. To postulate that the theory 
still applies in diluted or shifted circumstances is a 
leap of faith. Human beings are not, taken all together, 
very like the idealized pigeons or rats of Icarning 
theory, and their motivations and other circumstances 
are not easily controlled. Studies concerned with rate 
of repetition and reinforcement are scarcely relevant 
if the student hates or does not understand what he is 
doing. 


I do not mean to attack all Cal, or any teaching 
system which is effective and gratifying. What IT doubt 
is that sic systems for CAL will become more and more 
wonderful as effort progresses, or that the goal of talk- 
ing tutorial systems is reachable and appropriate. And 
what I further suspect is that we are building boredom 
systems that not only make life duller but sap intellec- 
tual interest in the same old way. 


Should systems ‘instruct?* 

Drill-and-practice systems are definitely a good thing 
for the acquisition of skills and response sets, an im- 
provement over workbooks and the like, furnishing 
both corrections and adjustment. They are boring, but 
probably Iess so than the usual materials. But the Cat 
enthusiasts seem to believe the same conversationalized 
chunk techniques can be extented to the realm of ideas. 
to systems that will tutor and chide, and that this will 
provide the same sort of natural interest provided by 
a live tutor’s instruction. 

The conventional point of view in cal claims that 
because validation is so important, it is necessary to 
have a standardized format of item, sequence and dia- 
logue. This justifies turning the endeavor into picky- 
work within items and sequence complexes, with 
attendant curftcular freeze, and student inanition and 
boredom. This is entirely premature. The variety of 
alternative systems for computer teaching have not 
even begun to be explored. Should systems “instruct” 
at all? 


‘Responding Resources’ and ‘Hyper-Media’ 

At no previous time has it been possible to create 
learning resources so responsive and interesting, or to 
give such free play to the student's initiative as we may 
now. We can now build computer-based presentational 
wonderlands, where a student (or other user) may 
browse and ramble through a vast varicty of writings, 
pictures and apparitions in magical space, as well as 
rich data structures and facilities for twiddling them. 
These we may call, collectively, “responding resources.” 
Responding resources are of two types: facilities and 
hyper-media. 


A facility is something the user may call up to per- 
form routinely a computation or other act, behaving 
in desired ways on demand. Thus joss (a clever desk 


-ealculator available at a terminal) and the Culler-Freed 
graph-plotting system (which graphs arbitrary func- 


tions the user types in) are facilities. 

Hyper-media are branching or performing presenta- 
tions which respond to user actions, systems of pre- 
arranged words and pictures (for example) which may 
be explored freely or queried in stylized ways. They 
will not be “programmed,” but rather designed, written, 
drawn and edited, by authors, artists, designers and 
editors. (To call them “programmed” would suggest 
spurious technicality. Computer systems to present 
them will be “programmed.”) Like ordinary prose and 
pictures, they will be media; and because they are in 


-some sense “multi-dimensional.” we may call them 


hyper-media, following the mathematical use of the 
term “hyper-”. 


A modest proposal 

The alternative is straightforward. Instead of devis- 
ing elaborate systems permitting the computer or its 
instructional contents to control the situation, why 
not permit the student to control the system, show him 
how to do so intelligently, and make jt easy for him 
to find his own way? Discard the sequences, items 
and conversation, and allow the student to move freely 
through materials which he may control. Never mind 
optimizing reinforcement or validating teaching se- 
quences. Motivate the user and let him loose in a 
wonderful place. 

Let the student control the sequence, put. him in 
control of interesting and clear material, and make him 
feel good—comfortable, interested, and autonomous. 
Teach him to orient himself: not having the system 
answer questions, all typed in, but allowing the student 
to get answers by looking in a fairly obvious place. 
(Dialogue is unnecessary even when it does not in- 
trude.) Such ultra-rich environments allow the student 
to choose what he will study, when he will study it and 
how he will study it, and to what criteria of accomplish- 
ment he will aim. Let the student pick what he wishes 
to study next, decide when he wishes to be tested, and 
give him a variety of interesting materials, events and 
opportunities. Let the student ask to be tested on what 
he, thinks he knows, when he is ready, selecting the 
most appropriate form of testing available. 

This approach has several advantages. First, it cir- 
cumvents the incredible obstacles created by the 
dialogue-item-sequence philosophy. It ends the danger 
to students of bugs in the material. And last, it does 
what education is supposed to do—foster student en- 
thusiasm, involvement, and self-reliance. 

Under such circumstances students will actually be 
interested, motivated to achieve far more than they 
have ever achieved within the normal instructional 
framework; and any lopsidedness which may result 
will be far offset by the degree of accomplishment 
which will occur—it.being much better to create lop- 
sided but enthusiastic genius specialists than listless, 
apathetic, or cruelly rebellious mediocrities. If they 
start soon enough they may even reach adulthood with 
natural minds: driven by enthusiasm and _ interest, 
crippled in no areas, eager to learn more, and far 
smarter than people ordinarily end up being. 

Enthusiasm and involvement are what really count. 
This is why the right to explore far outweighs any 
administrative advantages of creating and enforcing 
“subjects” and curriculum sequences. The enhancement 
of motivation that will follow from letting kids learn 
anything they want to learn will far outweigh any 
specialization that may result. By the elimination or 
benign replacement of both curriculum and tests in an 
ultra-rich environment, we will prevent the attrition of 
the natural motivation of children from its initially 
enormous levels, and mental development will be the 
natural straight diagonal rather than the customary 
parabola. 


Is it so hard? some ideas 


CAI is said to be terribly hard. It would seem all the 
harder, then, to give students the richer and more 
stimulating environments advocated here. This is be- 
cause of the cramped horizons of computer teaching 
today. Modest goals have given us modest visions, far 
below what is now possible and will soon be cheap. 


Discrete (Chunk Style) Hypertexts 


Source 


Summary 


Supplementary 
Text 


The static computer displays now associated with 
cAl will give way to dynamic displays driven from 
minicomputers, such as the IDIOM, IBM 2250/4 or 
Imlac pps-1. (The last of these costs only $10,000 
nows by 1975 such a unit will probably cost $1,000 
or Jess.) Not only will computers be much cheaper, but 
their usability will improve: a small computer with a 
fair amount of memory will be able to do much more 
than it can now, including operate a complex display 
from its own complex data base. 

It is generally supposed that systems like these need 
big computers and immense memories. This is not 
true if we use the equipment well, organize storage 
cleverly, and integrate data and display functions under 
a compact monitor. This is the goal of The Nelson 
Organization’s Project Xanadu, a system intended to 
handle all the functions described here on a mini- 
computer with disk and tape. 


Discrete hypertexts 


“Hypertext” means forms of writing which branch 
or perform on request; they are best presented on com- 
puter display screens. 

In ordinary writing the author may break sequence 
for footnotes or insets, but the use of print on pepe 
makes some basic sequence essential. The compu 
display screen, however, permits footnotes on footnotes 
on footnotes, and pathways of any structure the author 
wants to create. ; 

Discrete, or chunk style, hypertexts consist of sepa- 
rate pieces of text connected by links. 

Ordinary prose appears on the screen and may be 
moved forward and back by throttle. An asterisk or 
other key in the text means, not an ordinary footnote, 
but a jump—to an entirely new presentation on the 
screen. Such jumpable interconnections become part 
of the writing, entering into the prose medium itself as 
a new way to provide explanations and details to the 
seeker. These links may be artfully arranged according 
to meanings or relations in the subject, and possible 
tangents in the reader’s mind. 


Welcomingness and control 


CHOICE POINT 


GO ON 
| DON’T UNDERSTAND 

SO FAR I'M BORED 

EXPLAIN THE BIG PICTURE 
DETAILS PLEASE 

TIE THIS IN WITH SOMETHING 
| KNOW 


LET'S GO BACK TO LAST CHOIC 
POINT 
GIVE ME MORE CHOICES 


MORE CHOICES 


TEST ME 
DRILL ME 
RIDDLE ME 
DRAW ME A DIAGRAM 
TELL ME A RELEVANT JOKE 
CHANGE THE’ SUBJECT 
SURPRISE ME 


THUMPITY THUMP 
Performing hypergrams 
A hypergram is a performing or branching picture: 
for instance, this angle, with the bar-graph of its re- 
lated trigonometric functions. The student may turn 
the angle upon the screen, seizing it with the light-pen, 
and watch the related trigonometric functions, dis- 
played as bar charts, change correspondingly. 
Hypergrams may also be programmed to show the 
consequenees of a user’s prod—what follows or ac- 
companies some motion of the picture that he makes 
with a pointing tool, like the heartbeat sequence. 


Stretchtext Mills in the details 

This form of hypertext is casy to use without getting 
Jost. As a form of writing, it has special advantages for 
discursive and looscly structured materials—for  in- 
stance historical narratives. 


There are a screen and two. throttles. “The first 
throttle moves the text forward and backward, up and 
down on the screen. The second throttle causes changes 
in the writing itself: throttling toward you causes the 
text to become long." by minute degrees. Gaps appear 
between phrases; new words and phrases pop into the 


‘gaps, an item at a time. Push back on the throttle and. 


the writing becomes shorter and less detailed. 
The stretchtext is stored as a text stream with extras, 
coded to pop in and pop out at the desired altitudes: 


Stretchtext is a form of writing. 
It is read from a screen. The user 


controls it with throttles. It gets 
longer and shorter on demand. 


Stretchtext, a kind of hypertext, 
is basically a form of writing closely 
related to other prose. It is read by 
a user or student from a computer 
display screen. The user, or student, 
controls it, and causes it to change, 
with throttles connected to the 
computer. Stretchtext gets longer, 
by adding words and phrases, or 
shorter, by subtracting words and 
phrases, on demand. 


Hypermap zips up or down 

The screen is a map. A steering device permits the 
user to move the map around the world’s surface: a 
throttle zooms it in. Not by discrete jumps, but ani- 
mated in small changes, the map grows and grows in 
scale. More details appear as the magnification in- 
creases. The user may request additional display modes 
or “overlays,” such as population, climate, and indus- 
try. Such additional features may pop into view on 
request 


Queriable illustrations: a form of hypergram 

A “hypergram” is a picture that can branch or per- 
form on request. In this particular example, we see 
on the screen a line-drawing with protruding labels. 
When the student points at a label, it becomes a sliding 
descriptive ribbon, explaining the thing labelled. 
Or asterisks in an illustration may signal jumps to 
detailed diagrams and explanations, as in discrete 
hypertexts. 
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Dissection on the screen 


The student of anatomy may use his light-pen as a 
scalpel for a deceased creature on the screen. As he 
cuts, the tissue parts. He could also turn the light-pen 
into hemostat or forceps, and fully dissect the creature 
—or put it back together again. (This need not be a 
complex simulation. Many key relationships can be 
shown by means of fairly simple schematic pictures, 
needing a data structure not prohibitively complicated.) 


Hyper-comics are fun 

Hyper-comics are perhaps the simplest and most 
straightforward hyper-medium. The screen holds a 
comic strip, but one which branches on the student's 
request. For instance, different characters could be used 
to explain things in different ways, with the student able 
to choose which type of explanation he wanted at a 
specific time. 
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‘Technicality’ is not necessary 

Proponents of CAI want us to believe that scientific 
teaching requires a certain setup and format, incom- 
prehensible to the layman and to be Ieft to experts. 
This is simply not true. “Technicality” is a myth. The 
problem is not one of technical rightness, but what 
should be. 

The suggestions that have been given are things that 
should be; they will be brought about. [J 
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It was explained on the other side that 
computers have no fixed purpose or style of 
operation, but can be set in motion on detailed 
and repetitive tasks in any realm of human in- 
terest-- as long as those tasks are exactly 
specifiable in certain humdrum ways. 


Now, if you had a machine like that 
burning a hole in the corner of your office, 
what would you really want to do with it? 

You can't drive it on the road. 
(But see ps.) 


You can't make love to it. 


You can't cook in it, or get the news 
on it. 


To get it to control elaborate events in 
the real world requires a lot of expensive equip- 
ment and interfaces, so cross that out. 

Yet suppose you have an inquiring imag- 
ination-- which is not unlikely, considering 


that you are reading this sentence. 


And we are also supposing (from an ear- 
lier paragraph) that you have a computer. 


What sorts of thing would you do with it? 


Things that are imaginative and don't 
require too much else. 


I am hinting at something. 


You GOULD HVE IT MKKE PICTURES 
gud show you sutt 
and change wat Tshow 
depen "S on whaf 
you de; 


and if this idea doesn't turn you on, 
the rest of this book is probably not for you. 


The techniques of making pictures by 
computer are called computer graphics. 


But that includes the dull kinds of making 
pictures by computer, the ones that do it with 
pens and printing machines. 


The techniques of making computers 
present things interactively on screens is called 
computer display. (Some say "interactive com- 
puter graphics;" this is not just too long, but 
too restrictive as well: interactive text systems 


are not "graphic" or pictorial, but they are going 


to be a profoundly important area of computer 
display .) 


(Incidentally, the silly word "interaction" 
was coined because the previous word "inter- 
course," which meant exactly the same thing, 
had racy connotations for some people. Cf. 
"donkey" and "rooster," also relatively recent.) 


You will note that computer display is 
what makes possible the computer terminals with 
screens that we saw on the other side. All 
that a screen-terminal is is some sort of com- 
puter display, to which a keyboard has been 
added. 
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Responding computer displays 


come in all sizes and prices. This 
little setup (in the under- $10,000 
class) is a PDP-8 minicomputer with 
home-built display circuitry. Gothic 
lettering data structure available 
from somebody in the military; mes- 
sage courtesy of R.E.S.1.S.T.O.R.S. 
The big display is an IBM 2250 (over 
$100,000, including minicomputer). 
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You will therefore see that to understand 

all the different computer display terminals, 
you would have to understand all the different 
computer display techniques; unfortunately 

we can only cover a few here, and those but 
sparely. 


Some of the types of computer display to 
be covered hereabouts include: 


CRT, or cathode-ray tube, displays; 
these are my favorite because the 
stuff on their screens may be 
animated by the computer. 


video displays, which use television 
techniques. These have troubles 
deriving from the way a TV picture 
is timed. 


panel displays, i.e., those which appear 
on a flat panel. These are going 
to be cropping up all over. (The 
pictures can't move much, but the 
devices are going to be cheap. 
Flat, too. Some people think that's 
very important.) 


3-D displays, especially of the CRT type. 

~~ NOTE: this term refers ambiguously 
to two different things: setups which 
present flat views of three-dimensional 
scenes, and those which present 


stereoscopic views of 3-D scenes; 


these are much rarer. 


image synthesis or’ halftone techniques 
and systems. These are computer 
programs and special devices which 
make shaded or photograph-like 
pictures. (This happens to be a 
favorite topic of mine, and so there's 
quite a bit on it here, a lot of which 
is not widely known in the field.) 
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Newman and Sproull, Interactive Computer Graphics, 


McGraw, $15. Your basic text on.all forms of 
computer graphics (and thus animation). 
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DISPLAY TERMINALS 


Some computer displays have to be deeply 
attached to a computer and some don't. These 
latter we call display terminals. 


A display terminal is like an ordinary 
computer terminal (see p /4): that is, funda- 
mentally a device by which a computer and a 
person can type at each other. However dis- 


play terminals have screens. 


Now, some display terminals only show 

text, just like ordinary printing terminals 

escribed on the other side). But manufac- 
turers are free to add any other features, and 
so different manufacturers make it possible to 
do various kinds of picture-making with their 
particular display terminals, if appropriate 
programs afe running in the computer that con- 
trols them. 


Some devices are sold as display terminals 
but actually, to further confuse the issue, 
contain complete minicomputers. (The fact 
that the manufacturer may not stress this is 
simply a marketing angle he has chosen.) Simi- 
larly, certain terminals contain microprocessors 
(see p. 44), which means they can be programmed 
to behave like various other terminals, but ordi- 
narily they cannot be programmed to do much else 
by themselves. 


Without getting into it deeply, there are two main 
types of display terminal: those that are refreshed and 
those that are not. A refreshed display is one whose 
viewing surface fades and must be continually re-filled; 
a non-refreshed display somehow stores the presentation 
in the viewing surface itself. 


Non-refreshed displays simply take the symbols 
from the computer, blam them onto the screen, and that's 
it until the screen is erased (by either the computer or 
the user). 
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This honey ts the GT-40 
from DEC ($12,000, in- 
eluding computer-- the 
thing wtth teeth, below). 
It's a subroutining 
display (see p. DM 23). 


Man ts playing Moon- 
lander game: control- 
ling screen actton with . f 
lightpen. Computer simulates real moon lander. 
Reversed whtte-to-black for readability here. 


TOO FRST. YOURE GOING 70 CRASH 


THE WONDER oF 
INTERRCTINE DISPLAY SOCTEAS 


If you have not seen interactive computer 
display, you have not lived. 


Except for a few people who can imagine it-- 
and I'm trying to help you with that as hard as I 
can-- most people just don't get it till they see 
it. They can't imagine what it's like to manipu- 
late a picture. To have a diagram respond to you. 
To change one part of a picture, and watch the rest 
adapt. These are some of the things that can hap- 
pen in interactive computer display-- all depending, 
of course, on the program. 


For some reason there are a lot of people who 
pooh-pooh computer display: they say it's "not 
necessary," or "not worth it," or that "you can get 
just as good results other ways." 


Personally, I wouldn't thing of trying to 
justify computer display on "practical" grounds. 
So what if it offers you faster access to infor- 
mation and pictures and maps anddiagrams, the 
ability to simulate extremely complex things by 
modifying pictures, the ability to go through 
complex transactions with the system in very 
little time, the ability to create things in the 
world almost instantaneously (say, by creating 
fabric patterns which are then automatically 
woven, or design 3D objects which are then auto- 
matically milled by machines), and never mind 
that it enables the user, say, to control entire 
oil refineries by the flick of a lightpen. 


As far as I'm concerned, these matters 
aren't very important compared to changing the 
world: making education an excitement, tather 
than a prison; giving scholars total access to 
writings and notes, in new complex form; allowing 
people to play imaginatively, and raising human 
minds to the potentials they should have reached 
long ago; and helping people think at the deepest 
level about very heavy and complex alternatives-- 
which confront us more ominously today than ever. 
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Two major types are the storage tube and the panel. 
These in turn have separate subtypes, etc. 


Refreshed displays have to have some other kind of 


of symbolic (digital) memory, whose contents repeated- 
ly go to the screen: 
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Most refreshed displays use an actual television 
screen-- that is, a CRT (sée p.dm6-7) whose entire area 
is repeatedly re-painted by the elctron beam. 


Since computers send text out to terminals as in- 
dividual alphabetic and punctuation codes, each terminal 
must contain circuitry to change the character code to a 
visible alphabetical character on the screen. Such a 
piece of circuitry is called a character generator. There 
are various kinds, they go at various spends sone offer 
more different characters than others. 


Display terminals generally have a little marker, or 
cursor, that the user or the computer can move around the 
screen. The computer can sense what the user is pointing 
at by the motion codes it gets, telling where the user has 
moved the cursor. 


I had intended here to print a little directory of 
display terminal manufacturers, but there simply is not 
time. See section on terminals, other side. 


Note that the term video terminal is often used, in- 
correctly, for any display terminal. he term "video" 
should only be used when the screen is refreshed by an 
actual video raster. (See "Lightning in a Bottle," P- DAS]. ) 


Text terminals (also called alphabetic terminals, 
character terminals or keyscopes) simply show written text, 
put in either by the computer or the user. (Some terminals, 
called transaction terminals, can be divided up into specific 
areas that the user may and may not type into-- for banking 
and stuff. However, whether that form of terminal is 
necessary may also be a matter of taste in the program 
design.) 


Text terminals range in price from, say, $1500 on up 
to $6500. (This last is the price of a remarkable color 
text terminal demonstrated by Tec, Inc., at the 1974 National 
Computer Conference. Each alphabetic position could con- 
tain a letter and/or a bright color; altogether the screen 
could hold big colorful pictures made up of these bright 
Spaces. Ostensibly just a text terminal, actually the de- 
vice could be regarded as an Instant Movie Generator for 
television animation. But it may take Tec, Inc. awhile to 
realize what they have created.) 
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Graphic terminals offer some kind of pictures on their 

screens. These come in a great variety: line-drawing, some 

<> without, some with levels of grey. Of interest to the be- 

aa ginner are: 
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DIST, "The Tektronix." (Also called "the greenie," or 

mest "the green screen.") Tektronix, Inc., makes a 


display based on a pale green storage tube they 
make. (So does Computer Displays, Inc.) Such 
displays allow you to put more and more text and 
pictures on a screen, crowding it all up-- but 

you can't take the lines or words off individually. 
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"The PEP." Excellent (but very expensive) display 
that comes out to a video screen from a high-re- 
solution storage tube. Permits grey scales and 
selective erase. Princeton Electronic Products. 


The IDI graf (Information Displays, Inc., Mount Kisco, 
NY). Allows line pictures with animation; interest- 
ing unit; somewhat less than $10, : 


A PLATO-like terminal (see PLATO terminal, nearby, and 
pp-"26-27) is now available for use with STANDARD com- 
puter interfaces and software. "Less than $5000" 
from Applications Group, Inc., P.O. Box 444A, Maumee, 
Ohio 43537. ams 


REFRESHED HIGH-RESOLUTION COLOR SYSTEMS. A number of 
companies manufacture computer displays allowing com- 
plex grey-scale pictures, including color. They are 
expensive but very very nice. Indeed, if you buy them 
in clusters, these fancy-picture scopes can cost as 
little as text terminals. Some manufacturers are: 


Data Disk. (Disk refresh.) Note: I once recommend- 
ed them to a consulting client of mine, who 
later expressed complete satisfaction with 
their equipment. 

Ramtek ° (Se widouduefer Slor. e- 

Adage, Inc. Their model 200 is°a video system re- 
freshed from semiconductor storage. 

Comtal. (Disk.) 


Spatial Data Systems. (Disk.) 
Dicomed. (Disk) Extremely high resolution. 


Student programmer Alan McNeil, 
an art major, ponders something 
or other. It may be the program 
o the Nova space-game he and 
Pete Rowell are building. 

Alan also made a film showing what 
may have been the motions of the 
conténents, shooting stratght off 
the PLATO screen. 

Some PLATO purtste point out that 
this is not exactly what PLATO 
was originally intended for. So? 


PLATO panel display (see DM 26-7). 
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MEN AT NoRK 


The computer display screen is the new 
frontier of our lives. 


That such systems should (and will) be 
fun goes without saying. That they will also 


be a place to work may be less obvious from 
the tone of this publication, so I want to stress 
it here. 


Making ptetures wtth the GE 
halftone system (see pp. DM 32-9). 


The thing about display screens-- especial- 
ly the high-performance, subroutining kind-- 
is that the screen can become a place from 
which to control events in the outside world. 


Example: I believe a town in N.Y. State 
has its electrical system hooked up to an IDIIOM 
subroutining display (made by Information Dis- 
plays, Inc., and coupled to a Varian 620 mini- 
computer). Instead of having a wall with a big 
painted map having switches set into it, like 
many such control centers, the switches are 
linked directly to the minicomputer, and a pro- 
gram in the minicomputer connects these circuits 
to the pictures on the screen. Thus to throw 
a switch in the real world, the operator points 
with his lightpen at the picture of the switch, 
and the minicomputer throws the switch. 


There are oil refineries that work the 
same way. The operator can control flows 
among pipes and tanks by pointing at their 
pictures, or at symbols connected with them, 
and bingo, it happens Out There. 


In another case, a person designing some- 
thing at a screen can look across the room and 
see a machine producing what he just finished 
designing a few minutes ago. I wish I could 
say more about that particular setup. 


The true problem that I think is emerging, 
though, is the problem of system response and 
style. Okay, so you're controlling widget 
assembly, or traffic light grids, at the CRT 
screen. The real question is, how does the 
screen behave and respond? This is not, darn 
it, a technical issue. It's psychological and 
then some. The design of screen activities 
which will enjoyably focus the user's mind on 
his proper concerns-- no matter how personal 
these may be-- is the new frontier of design, 
of art, and of architecture. But more of that 
later. 


Now, the Xerox Corporation has said that 
they intend to replace paper (or, the way I 
heard it, "Somebody is going to replace paper 
with screens, and it will be either IBM or us, 
so let's have it be us.") 


Well and good. Save the trees and stem 
the grey menace. But the question is: what 
will the systems be like? How should they per- 
form? What forms will information take? What 
conventions, structures, diagrams, animations, 
ways to sign things, ways to view things . 
HOW SHALL IT BE? 


I am afraid that as long as people are be- 
fuddled with technicalities, or confused by those 
who profess that these considerations are their 
specialty by right, we will never get straight. 
Lacking time for the full discussion, I give you 
a motto: 


IF THE BUTTON IS NOT SHAPED LIKE THE THOUGHT, 
THE THOUGHT WILL END UP SHAPED LIKE THE BUTTON. 
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SAVING ENERGY WITH COMPUTER DISPLAY 


A timely criticism of computer display is 
that it needs electricity. But (as mentioned 
elsewhere) it saves paper, and, importantly, it 
bodes to save energy as well. 


IF WE SWITCH TO COMPUTER SCREENS FROM 
PAPER, PEOPLE WON'T HAVE TO TRAVEL AS MUCH, 
Instead of commuting to offices in the center 
of town, people can set up their offices in 
the suburbs, and share the documentary struc- 
ture of the work situation through the screens. 


This view has been propounded, indeed, by 


Peter Goldmark, former director of research for 
CBS Labs, the man who brought you the LP record. 
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|F COMPUTERS ARE THE 
WAVE OF THE FUTURE , 


ISPLAYS ARE 
THE SURFBOARDS. 


x THE WINDS LYE, Continved, 


YOUR BASIC TYPES OF COMPUTER DISPLAY 


(Note: the term "display" is also used 
in this field to refer to numbers and letters 
that can be made to light up in fixed positions, 
like on your pocket calculators. Those will 
not be discussed here. If you're interested 
see an article on the subject by Alan Sobel, 
Scientific American, early 1973 sometime.) 


THE FORKED LIGHTNING 


" Because their words have 
forked no lightning they 
Do not go gentle into that good night." 
-- Dylan Thomas 


The most basic, and yet eventually the 
most versatile, computer display is that of the 
CRT, or bottled lightning (as I like to call it). 
It is, you know: a beam of electrons, just like 
lightning in a storm, but from the neck of a 
very empty bottle to its flat bottom, whose 
chemically coated surface we watch. As manip- 
ulated by the computer, the CRT stabs its beam 
to all corners of the faceplate: forked lightning. 


Computer display began in the late forties. 
Computers themselves were completely new, 
and so was Mr. Dumont's magical Cathode Ray 
Tube or CRT (see p.™%), developed on a 
crash basis during the war so we could have 
radar, and as long as it was around after the 
war, we got television. 


But the lightning bottle, or CRT, can be 
used in a variety of ways. Its control plates, 
which move the ray of electrons around on the 
screen, can be given various different elec- 
tronic signals, causing the beam to move around 
in different patterns. In normal video, the 
signals move the beam in a zigzag pattern, 
where the zigs are very close together and the 
zags are invisible; the carpet of zigs covers 
the screen over and over in a repetitive pattern, 
and the beam's changing intensity paints the 
picture. 


But we can drive the CRT differently. 
by using different control signals. For instance: 
we can apply a measured voltage to the height 
or "Y" plates of the CRT, moving the beam 
to a given vertical position, and another meas- 
ured voltage to the sideways or "X" plates, 
controlling its horizontal position. 
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1. EARLIEST SYSTEM: A LITTLE PROGRAM 
TO MAKE DOTS 


The earliest setup connected a CRT to a 
computer by the simplest possible means, and 
made its pictures with dots on the screen-- a 
sort of tattooing process. 


It was simple because all the computer 
did was furnish to the connecting circuitry (or 
interface) symbols specifying how far up, and 
how far across the screen, the next dot should 
be. These symbols were actually coded numbers, 
and the interface turned them into voltages which 
then moved the beam correspondingly. (This 
process of making a measured voltage out of a 
coded numerical symbol is called digital-to-analog 
conversion, since (as explained on the other side) 
the main meaning of "analog" these days is "in 
a measured voltage.") 


Now, this has several drawbacks. One is 
that the lines are dotty; nobody likes that. A 
more important annoyance, though, is that the 
computer scarcely has time for anything else. 
Here is a flowchart of what the computer has to 
do in its program. (Even if you didn't look at 
the other side of the book, flowcharts are nothing 
scary. They're just maps of what happens.) 
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Furthermore, and here was the indignity 
of it, this system took far too long. To draw 
a line with thirty dots in it took thirty times 
around the, loop in the flowchart, and since each 
box in the flowchart takes at least one of the | 
machine's rock-bottom instructions-- usually 
more-- then the main loop of this display routine 
takes four separate operations per dot, or 120 — 
operations for a stupid 30-dot line. Plainly 
there has to be a better way to use an expensive 
computer. 


Actually it wasn't just the ignominy of it, 
but the fact that it took so long, that made this 
a poor method. The amount of stuff the compu- 
ter could draw in 1/40th of a second-- and this 
turns out to be how fast the whole picture has 
to be made-- was too little. After 1/40th of a 
second the human eye can see the lines on the 
CRT start to fade, and so the picture has to be 
redrawn to make it bright again before that 
happens. If your eye sees the picture fading, 
then when the computer draws the picture again 
you will see it get suddenly bright again-- and 
it will start to flicker. This is distracting, un- 
healthy, and disagreeable. 


Note that the most important computer in 
the history of computer display used this tech- 
niqué "This was the TX-2 at Lincoln Labora- 
tories, a highly-guarded installation outside Bos- 
ton which is formally part of MIT. The TX-2 
was one of the first transistorized computers-- 
perhaps the first; and on it were programmed a 
number of milestone systems, including Suther- 
land's Sketchpad, Johnson's Sketchpad IV, and 
Baecker's GENESYS animation system (discussed 
somewhere). 
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2. LINE-DRAWING HARDWARE 


The next step in design is to get the com- 
puter program out of the business of drawing 
lines by a succession of dots. So we build a 
piece of hardware that the computer program may 
simply instruct to draw a line. As an interface, 
it looks to the computer like four separate 
devices: registers that tell where on the screen 
the line must start ("first X" and "first Y") and 
registers that tell it where to stop ("end X" and 
"end Y"). 


VARIOUS 
Clas 


This speeds things up considerably, and 
allows the computer program to display on the 
CRT simply by telling the device what lines it 
wants drawn. Moreover, the program is free 
to do other things while each line is being 
drawn, though this involves the problem of how 
the program is to know when it's time to send 
out another line-- and we needy't go into that 
here. 


(ncidentally, it is a puzzling fact that 
such a device is available nowhere, although 
lots of people end up building one for themselves. 
There was such a thing on the market a couple 
of years ago-- line-drawing hardware with no 
interface and no CRT-- but it was withdrawn 
because of reliability problems. A just price, 
if anybody wants to go into that, would be five 
hundred to a thousand dolars-- this year.) 


3. EVOLUTION FROM THIS: TWO OPTIONS 


There. are basically two ways to go from 
this basic starting point. Either we can keep 
the display device intimately and integrally con- 
nected to the computer, or we can say the hell 
with it and cut the display device loose as a 
separate entity. 


Ivan Sutherland has cannily noted that 
there is a certain trap involved in these designs: 
as we build additional "independent" structures 
to take the burden of display away from the 
computer, we are tempted to keep adding fea- 
tures which make the "independent" structure a 
computer in its own right. This paradoxical 
temptation Sutherland calls "the great wheel of 
Karma" of computer display architecture. 


It is tempting to cut the display loose from 
the computer. It means the computer can be 
fully occupied with other matters than refreshing 
the screen-- preparing the next displays, per- 
haps. Many computer people believe this is the 
right way to do it, and it is certainly one valid 
approach. But unfortunately it also drastically 
reduces the immediacy of the system's reaction, 
making interaction with the system less intimate 
and wonderful. 


Approaches which put display refreshment 
and maintenance in a separate device: are less 
interesting to me, and so that discussion contin- 
ues separately nearby. (“Displey Terminals * p- pn21). 


Ths article Coun ves new page.) 


4. THE SECOND PROGRAM FOLLOWER 


On the other side of. the book, I explained 
that a computer is basically a zippy device, 
never mind how constructed, which follows a 
program somehow stored symbolically in a core 
memory. Such a device we call here a program 
follower. While programs may be in many com- 
puter languages-- all of them contrived systems 
for expressing the user's wishes, in different 
styles and with different general intent-- under- 
neath they all translate to an inner language of 
binary patterns, which may just be thought of 
as patterns of X and O, or light bulbs on and off. 
The innermost program follower of the computer 
goes down lists of binary patterns stored in the 
core memory, and carries them out as specific 
instructions. It also changes its sequences of 
operations under conditions that the programmer 
has told it to watch for. 


The most powerful and responsive com- 
puter displays are those which build a second 
program follower which goes down lists of pic- 
ture-drawing instructions also stored in the same 
core memory. 


COMPUTER 
PROGRAM 
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This design has some extraordinary advan- 
tages. One is that since the computer's program 
follower and the display's program follower both 
share the same core memory, they can work to- 
gether most intimately. When the user demands 
something new-- by typing, say, or pointing 
with a light-pen-- the computer can step in and 
take various actions. Its program can compose 
a new picture for the user, get something from 
a disk or tape memory, or switch the display's 
program follower over to a new picture it has 
already prepared. 


Most importantly, the computer can move 
images on the scren, allowing interactive ani- 
mation on the screen under the user's control. 
Each time the display starts to show the same 
picture again, the computer simply supplies it 
with a new starting point. Since the list of lines 
is typically in the form of sequences of lines 
relative to one another, the picture is drawn in 
a new place each time-- and thus seen to move 
on the screen. 


Finally, the computer itself is free most 
of the time-- free, that is, to do other things, 
which typically is always desirable. Just how 
much the computer can or should do in such a 
partnership is a matter of dispute. (Ordinarily 
such devices are spliced onto minicomputers; 
and minicomputer fans, such as the author, see 
no reason not to perform all services for the dis- 
play there in the minicomputer-- and a pox on 
the big machines. Others, for various. reasons, 
see the subroutining display and its host mini 
as needing the tender ministratious of a big- 
computer via some sort of communications line. 
There are various reasons for holding this en- 
tirely legitimate view. People who are devoted 
to the high number-crunching capacity of big 
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These earlier machines are being replaced 
by new versions with better-designed instructions 
(see "Computer Architecture," p.32, for a sense 
of what well-designed instructions are). An es- 
pecially fine unit is DEC's GT40, which buckles 
on the exceptionally fine PDP-11 minicomputer o 
(see p. 42). The GT40 is illustrated nearby. (p-21) 
It goes for some $12,000 including the computer. 
(That's today, we repeat. Consider not the price 
at this instant, but how fast it's going down.) 


The units mentioned above are of the most 
basic type: "two-dimensional," whose pictures 
at any given instant correspond to flat drawings 
-- but, of course, derive their excitement and 
magnificence from their capacity to interact, 
change and animate what you are looking at. 


RTE WWD'S KYEH coufnues on p, DMSO. 


Sctherland 's SKETCHPAD 


Seldom has an event in a new field had as much power and 
influence as what dour Ivan Sutherland did as a young man ‘athe 
period 1960-64. 


The SKETCHPAD system, which was basically his thesis work at 
MIT, was at once inventive, profound, overwhelmingly impressive 
to laymen, and deeply elegant. Simply for the universal influence 
it has had in the computer field, it deserves our close attention. 


Sutherland was one of the first people to understand the use 
of the computer in helping people visualize things that weren't 
fully clear yet-- the opposite, of course, of the conventional 
notion of computers. While computers had been made to do animations 
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We may call this also a "list-of-lines" 
system, since the commands recognized by the 
display program follower are typically patterns 
that tell it what lines to draw. 


Typically also it has its own way of jump- 
ing around in a program, and may jump to a 
specific list of lines, or subpicture, from numer- 
ous other parts of its program, always returning 
each time to the point from which it had jumped. 
This ‘allows the same subpicture to appear in 
numerous places on the screen at the same time. 
(A program that can be jumped to by other pro- 
grams which then resume operation is called a 


store large bodies of data only on big computers 
-- not because big disk and tape memories can't 
be easily attached to the small ones, for they 
can, but they usually aren't; and other ways to 
tie minicomputers to big stores of data aren't 
available yet.) 


Subroutining displays often have commands 
allowing. them to display text as well as lines 
and dots. In the display of text they can use 
the same technique of "moving the picture" by 
starting its display at successively creeping 
points; this will cause, say, whole paragraphs 
to slide on the screen. The importance of 
this feature in the displaying of text cannot be 
overemphasized. As more and more people have 
experience with displays of different kinds, they 
are beginning to realize how confusing and dis- 
orienting it is for a screen to clear and be filled 
with something new to read. You don't know 
where you are. On subroutining displays, 
moving the text can give the reader the same 
sense of orientation he gets from turning pages 
-- an important thing to replace. 


REwaret 


SKETCHPAD ran on the 36-bit TX-2, a one-of-a-kind experimental 
machine at Lincoln Laboratories (a military research place nominally 
a part of MIT). It hada display screen, light pen and lots of handy 
switches. 


SKETCHPAD was basically a drawing system. But rather than 
simulating paper (as some people might have done), it found splendid 
ways to take advantage of the computer's special capabilities. 


In the Sketchpad system, Sutherland looked for ways that a 
responding computer display screen could help people design things. 
He pioneered methods of drawing on screens, with such techniques 
as the "rubber-band line" (a straight line on the screen, one end 
of which follows your lightpen while the other remains fixed), and 
the "instance"-- a subpicture stored in core memory which could 
appear numerous times and ways in a larger picture). 


This picture vaguely 
stmulates the "instance" 
factlity of Sketchpad, 
by whiten an overall 
pteture may be created 
out of repetitions of a 
single master pattern. 


Simulated wtth GRASS 
language (see p.31). 
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This design has some extraordinary advan- 
tages. One is that since the computer's program 
follower and the display's program follower both 
share the same core memory, they can work to- 
gether most intimately. When the user demands 
something new-- by typing, say, or pointing 
with a light-pen-- the computer can step in and 
take various actions. Its program can compose 
a new picture for the user, get something from 
a disk or tape memory, or switch the display's 
program follower over to a new picture it has 
already prepared. 


Most importantly, the computer can move 
images on the screen, allowing interactive ani- 
mation on the screen under the user's control. 
Each time the display is about to show the same 
picture again, the computer simply supplies it 
with a new starting point. Since the list of lines 
is typically in the form of sequences of lines 
relative to one another, the picture is drawn in 
a new place each time-- and thus seen to move 
on the screen. 
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It must be stressed here that, just as com- 
puters themselves have no fixed mode or style 
of operation, neither do computer displays; and 
so the purpose of such devices is simply 


HELPING PEOPLE SEE AND MANIPULATE 
PICTURES AND TEXT 
IN ANY STYLE, AND FOR ANY PURPOSE. 


Since pictures can be of anything, and text can 
be about anything, this effectively comprehends 
the entire mental and working life of mankind. 


Many readers will scoff, supposing that 
computer display systems will always cost tons 
of money. This is not the case. You can al- 
ready get a beauty, with its minicomputer, for 
as little as $13,000; and this price should fall 
to three or four thousand within a few years-- 
as soon as the minicomputer manufacturers realize 
that the market frontier is not in the office or 
factory, but in the home. But we're getting a 
bit ahead of ourselves here. 


TYPES OF SUBROUTINING DISPLAY 


Some early subroutining displays used a 
screen-dotting technique, but took the burden of 
it off the computer itself: it would extract from 
core memory the instructions telling it to draw 
individual lines and show text. (I refer here 
to the DEC model 338, introduced about 1965; 
this attached to a PDP-8 computer (see p.49) 
and cost about $50,000 including the computer.) 
Others drew lines as straight zips of light across 
the screen; an example is the IBM 2250 display, 
introduced about 1966. (The model 1 of this 
device buckled directly to the 360, and cost, I 
believe, something like $75,000; its successor, 


move and manipulate the picture on the screen, with all its parts. 
One overall picture could be constructed out of a hundred copies 
of a basic picture; then a change in the basic picture would im- 
mediately be shown in all hundred places. Or you could expand 
your picture until it was effectively the size of a football field 
(with you looking at a tiny view in the handkerchief-sized screen). 
Or you could draw meshing gears on the screen, and with the light- 
pen (and through the "constraint" facility) make one gear turn by 
turning the other! 


This elegant technique, the constraint,does not seem to have 
been imitated even now. A “constraint" was a restriction placed 
on some part of the overall stored picture compleX. The user 
could move or manipulate various parts of the picture on the screen, 
but the parts that had constraints could only move in certain di- 
rections, or according to certain formulas, or dragging other 
parts along, etc., as specified. 


This was a profound idea, because it meant that any rules for 
the manipulation of particular objects on the screen could be added 
to Sketchpad as particulars within the larger program, rather than 
having to be programmed in from scratch. 


(One extremely interesting aspect of Sutherland's thesis, which 
Most people seem to have missed, dealt with displaying a structure 
of constraints: that is, showing what elements depended on what 
other elements, in a highly abstracted diagram that the system could 
show you. This form of display has remarkable possibilities. 


After his brilliant SKETCHPAD work, Sutherland was made head 
of ARPA's computer branch (see "Military," p. 5% ). There he was 
involved in many of the computer funding decisions of the late 
sixties, which contributed to the impetus of computer display. 
(His predecessor, Licklider, had been a pioneer in time-sharing, and 
much of the forward movement in the computer field in recent years 
may just have had to do with the strategic position of those two men 
when they were at ARPA/IPT.) 


Sketchpad went on as a continuing research tradition at Lin- 
coln Labs. Timothy Johnson, for instance, made a version of it that 
allowed the drawing of three-~dimensional objects; this became the 
forerunner of the various three-dimensional line systems described 
hereabouts. 


From ARPA, Sutherland went on to the University of Utah, 
whence he slipped off with the Computer Science department chair- 
man to found the Evans and Sutherland Computer Company, makers of 
the top-of-the-line computer display systems (see p. DM3% and p.jM3})- 


Sutherland's work has shown an elegance and inventiveness 


y) no| dite outstanding in the field. (For instance, I believe one issue of 
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Conpuree Movies 


How do computers make movies? 


Well, first of all, computers do not make 
movies unless thoroughly provoked. 


In fact, only people make movies. But 
computers, if sufficiently provoked, will do a 
lot of it: enact the movie and photograph it, 
frame by frame. 


There is no single method. 


All forms of computer display and computer 
graphics may be used to make computer movies. 


"Computer animation" is any method of mak- 
ing movies in which a computer successivel 
p y 


draws or paints the successive individual frames, 


which may be done by any of the methods mention- 
ed in this book. Now, since there are numerous 
methods of making pictures by computer, then any 
method of making different individual pictures, 
in a succession of Changing frames, is computer 
animation. So a "computer movie" is any film 
made by, or with the picture-making aid of, 
computers. 


In other words-- it's no one thing. 


Now, there already exist hundreds, if not 
thousands, of computer movies. So far most of 
them have been on technical topics-- the mecha- 
nics of satellite orbit stabilization, the 
mechanics of explosions and so on. 


Here are a few stills from some other movies, 


more humanistic. 


BIBLIOGRAPHY 


Newman § Sproull, Interactive Computer 
Graphics. McGraw, Sh >5 


This is the textbook. Anyone 
interested in computer display 
should get this immediately. 


An expensive journal, Computer Graphics 
and Image Processing, comes from 
Academic Press. 


Sherwood Anderson, “ Computer Animation: A Survey. 


Journal of Micrographics, Sep 71,.. 13-20. 
Lists nineteen computer~animation languages 


of that time. 


Ken Knowlton, “Computer—Made Films," Filmmakers 
Newsletter Dec 70, 14-20. 


Instructions 
for the desired 
movie enter the 
computer as a 
deck of punched 
cards. 


Vintage Knowlton, using BEFLIX. 
(This Language used the COM quite 
efftctently: dots were actually 
out-of-focus letters. ) 


Vanderbeek & Knowlton (using TARPS, 
whitch shows strong tnfluence of 
BEFLIX, which tt grows from). 
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LILLIAN SCHWARTZ 


A talented artist with a feel for tech- 
nology, Ms. Schwartz has been working for 
several years with Knowlton and others at 
Bell Labs. Her films with Knowlton, mention- 
ed elsewhere, are marvelous. She now works 
at a more permanent setup, a minicomputer 
that runs successive images on a color TV 
screen, employing a modified form of Knowl- 
ton's EXPLOR language. The work is immediate- 
ly viewable. This allows rapid film con- 
struction, not previously possible when the 
work had to go through a slow animation 
camera before she could see the result. 


For Knowlton-&-Schwartz films contact: Martin 
Duffy, AT&T, 195 Broadway, NY NY. 


Schwartz &@ Knowlton. Using the EXPLOR language, 
they make ptctures and patterns seintillate and 
grow together. (EXPLOR in some ways generalizes 
Conway's Game of Life; see p.4f and p. DM 716) 


JOHN WHITNEY 


John Whitney is the ancestor of us all, 
probably the first computer movie-maker. He 
is also a gripping speaker. 


In the forties, he built a special anima- 
tion stand-- using analog computers. 


Deeply concerned with music, Whitney has 
in his images emphasized rhythmic and contra- 
puntal movement of shapes and lines. 


Whitney films available from: Pyramid 
Films, Box 1048, Santa Monica CA 90406. 
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LYNN SMITH 


Lynn Smith is a young Boston artist 
who has worked extensively with Baecker's 
GENESYS (see nearby). One result has been 
a movie which should be an example to us 
all: "The Wedding Movie for Bob and Judy." 
(Her Friends Bob and Judy were getting 
married, so she made this movie,a few mi- 
nutes long and quite clever, to celebrate 
4%.) 


RON BRECKER's GENESy s 


By now there are dozens of computer anima- 
tion languages-- perhaps hundreds. Each one em- 
ploys the techniques of animation which its de- 
veloper wanted to use, tied together in the ways 
that seemed appropriate to him. (See "Computer 
Languages," p. 15, and note Knowlton's various 
animation languages, described nearby.) 


This is my favorite example of how 
computers should be used in the human 
world; it says more on the subject than 
any dozen articles. 


One of the more influential animation systems 
has been Ron Baecker's GENESYS, a 2-dimensional 
animation system programmed in the late sixties at 
MIT's high-security Lincoln Laboratory. (It used 
the TX-2 computer, mentioned elsewhere in this 


book. ) (One question that remains unanswered 


is how a system like GENESYS could have 
been used for such a purpose, seeing that 
most people in the field believe GENESYS 
only runson the heavily-guarded TX-2 com- 
puter. Regretfully, I can shed no light 
on this here.) 


Baecker, a cheery and genial fellow, expressed 
interest as a student in using the TX-2 for anima- 
tion, and was allowed to. The system he produced 
has a number of lessons for us all. 


GENESYS is a "Good-Guy" system,as discussed 
on p. | Meaning, in this case, that it is 
easy to learn and simple to use. As argued else- 
where in this book, making computer systems clear 
and simple is often hard for the programmer (and 
may go against his grain), but is essential. 


PICTURES AND MOTIONS 


GENESYS makes the following simplifications 
of your movie: all images are made up of dots. 
They do not change as you watch; animation con- 
sists of the images either moving or being re~ 


placed. 


To create an image, you draw it onto the 
screen with a lightpen or a tablet. (As in the 
SKETCHPAD system; see p. #157.) Parts of.the 
image may be changed until you're satisfied. 


PICTURE 4 AcTure i 


Now, to create the animation, you do the 
same thing. Each image can be made to move on 
the screen; and the path of the motion may be 
drawn on the screen, through the picture area. 
Not only that, but the timing of the motion is 
controlled through the same diagram, by the 
spacing of the dots. (Baecker calls his control 


diagrams p-curves.) 


( Computer 
Output 
$ Microfilm 
devices } 


are what you use to make computer movies. 
Basically they consist of a CRT and a movie 
camera in a box. 


Mostly they are used to put text on 
microfilm by computer, so generally they 
are not connected to a computer but run 
off magnetic tape. 


This turns out to be very annoying if 
you want to hook up the computer directly 
to the COM, and make movies that fill the 
frames spot-by-spot. For that you really 
need your own movie camera and a minicompu- 
ter. (Movie cameras that can be made to 
start and stop by computer are called “pulse 
cameras" or “instrumentation cameras.") 

The society for people who make Movies by 
Computer is called UAIDE«(Users of Auto- 
matic Information Display Equipment-- an 
obsolete title). It used to be a club just 


Lastly, sections of picture may be re- 
placed by means of the control diagram (as 
indicated in picture above). 


Having created such an animated sequence, 
which is stored in symbolic form in the com- 
puter ("digitally"), you can view it on the 
screen, decide what you do and don't like 
about it, and change any part of it. 


The basic elegance of the system is this: 
Baecker made everything work the same way, 
through control by screen diagrams. He simpli- 
fied the animation problem in a clear and simple 
way. 


Ron now teaches in Canada and is into work- 
ing with PDP-lls. The results should be fun. 


for companies that owned COMs made by 
Stromberg Datagraphix, but evidently it has 
now cut itself loose and become a subsidiary 
of the National Microfilm Association, 8728 
Colesville Road, Silver Spring MD 20910. 


(NOTE: for them as want to make color 
movies, the two alternatives have been either 
to have separate primary negatives combined 
at a lab-- the “old Technicolor" process-- | 
or to add a complicated color-filter box to 
a COM or other CRT setup. Such things are 
available commercially now, from Dicomed-- 

a whole Color COM.) 


BIBLIOGRAPHY 
Computer Output Microfilm. $10 from National 


Microfilm Assn., above. Lists available 
COMs and service centers. 
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THE 
New REPUBLIC 


PLATO is the world's greatest computer display 
system. * 


Some 500 users, at terminals around the world 
(but mostly in Illinois), simultaneously tie up to 
a big computer in Urbana, Illinois and savor instan- 
taneous pictorial and text deliver ies on their bright 
Orange screens. Diagrams, explanations, tests and 
even animation of a sort, flow almost without inter- 
ruption to the bright orange screens all over. The 
system is extremely responsive: depending on what the 
user is up to, its various programs can respond to 
each pressing of a key, usually within a fraction of 
a second. 


While literature on PLATO is copious, it is 
hard to read and slightly sales-oriented. But a f-w 
minutes' intercourse with a PLATO terminal makes 


anyone an enthusiast for the system. 


PLATO is the brainchild of Don Bitzer, a U. of 
Illinois engineer who has devoted over a decade to 
its creation. Michael Scriven, no slouch himself, 
has called Bitzer “one of the great men of our time." 
Bitzer is also certainly one of the world's greatest 
salesmen. A crew-cut, huggy-bear sort of a fellow, 
he flies around the world demonstrating, lugging a 
great terminal along. When you sign on the system 
you may be informed that Bitzer is at that very mo- 
ment demonstrating in Paris or Tokyo. This "travel- 
ling dog and pony show," as PLATO staffers call it, 


has created awe and excitement wherever it goes, and 
where the awe has been strong enoug!: te generate money, 
tnere you will now find PLATO terminals. 

If you have a PLATO terminal-- “you presumably 


being a school or other favored institution-- you can 
in principle log onto PLATO from anywhere in the world, 
though most terminals stay in one place. There is one 
main network, consisting of a big Control Data compu- 
ter in Urbana (the model 6800; see p. 4] ) with ten- 
drils extending out into the phone system and the 
educational TV cable of the state of Illinois. When 
the Urbana system is "finished" and fully loaded, it 
will have 1008 terminals; all are already spoken for. 
The PLATO terminal is a totally unique animal (see box), 
manufactured (all too slowly) by Magnavox, incorpora- 
ting a terrific plasma panel built by Corning. (The 


plasma panel was invented by Bitzer, and even though 
much of PLATO was publicly funded, he is reputedly 
rich ffom it. We said he was a great politician.) 


* In terms of htgh performance for lots of users. 
Vartous systems (described hereabouts) offer 
more power, but at huge cost. 


g—_—————_+ 


As a first taste of interaction 
on a graphical computer system, PLATO 
can be a tnriiiing mind-opener-- es- 
pecially to people wno think computers 
can only behave loutishly or through 


C printout. 


PLATO's audio device permits 
the system to respond to the 
user with a spoken phrase, 
snatch of muste, or whatever 
-- ina fractton of a second. 
The magnetic disk ts forever 
turning; compressed air shoots 
the read-head to the required 
track on the disk for the reply. 


PLATO is a complete stand-alone system, with its 
own monitor program or "operating system" (see p. 4S) 
running on the CDC 6800 computer all by itself. It 
does not run on any other manufacturer's computers, or 
simultaneously with any other big programs. It com- 
municates only with PLATO terminals, no other, and 
PLATO terminals, because of their unusual design, can 
communicate only with it, partly because of its unus- 


ual design and partly because of its unique 20-bit 
interface. (See diagram of PLATO terminal, box nearby.) 


A PLATO terminal costs about $4000 and the price 
seems to be going up; $5000 in the next few years is 
a popular estimate. But you can't just buy one. You 
have to get on the waiting list, and who are you, any- 
way? There was a time when almost anybody could buy 
into PLATO, but now that the system is unstoppable; 
applicants are being scrutinized. ; 


Is it really unstoppable? Educational ‘Testing 
Service, of Princeton, is conducting an elaborate Ef- 
fectiveness Evaluation of the PLATO system, presumably 
to decide whether it should live or die (on public 
funds). But with so many terminals in the field al- 
ready and so many man-years already gone into its crea- 
tion and the making of materials for it (-- the ghastly 
term ‘authoring" seems likely to stick), it is hard 
to believe PLATO could die. Not now. 


Especially considering that two more systems are 
now being put together: at Lowry Air Force Base (Colo- 
rado) and Florida State University. That means there 
will be whole other computers of the CDC 6000 series 
running the PLATO Monitor and shepherding PLATO mater- 
ials to users at PLATO terminals, unconnected to Ur- 
bana, one for Lowry AFB and one in Florida. 


And it won't end there. 


Control Data, whose vested interest in the sys- 
tem (though they didn't pay for its creation) is enor- 
mous, is said to be projecting 


ONE MILLION PLATO TERMINALS BY 1980. 
Another sign in the wind: Montgomery Ward has one. 


Now, to call the PLATO system a “computer graph- 
ics" system may seem somewhat odd to people who know 
it in another guise, as a system for Computer-Assisted 
Instruction (called CAI). But as the author does not 
like CAI in general, at least as it's been going-- 
see p-3-/¢ ~~ and rather likes PLATO, I prefer to des- 
cribe it as I prefer to see it. 


Nevertheless, to understand PLATO properly we 
had better consider what the people have been doing 
in terms of what they think they have been doing, and 
offer any amendments or restatements later. 


"OPTIMIZED FOR CAL" 


PLATO stands for "Programmed Logic for Automated 
Teaching Operations," and has been billed (and sold) 
as a system for automated instruction. 


It is, most PLATO fanciers will tell you, "op- 
timized for instruction."' ("Optimized,"' in computer 
talk, means "just what somebody says you need for a 
specific purpose.) As with any system, the leaps of 
faith between its basic design premises have become 
lit by airport beacons; clearminded individuals with 
alternate views have difficulty making themselves 
understood to some PLATO enthusiasts. But the most 
basic underlying feature of the system, INSTANT RES- 
PONSE, cannot be quarreled with. PLATO can respond, 
as already mentioned, to a single key-pressing by a 
user, almost instantly; this feature is virtually im- 
possible, say, on IBM systems (but see. box, P- 5 }s 
this responsiveness is the system's greatest beauty. 


Because of the need for high responsiveness, it 
was decided that all users had to have their partic- 
ular programs ("lessons") running in core at the same 
time. That meant there would be no swapping (bringing 
in materials from disk memory), which can bring morti- 
fying delays (if a lot of people need it at once); but 
it also meant lessons have to be very small. Large 
bodies of material, which would have to be moved in 
from disk, are not allowed; thus each lesson is basic- 
ally a little love-nest that must generate its own 
action. Hence there is an emphasis on little programs 
to respond various ways, rather than text which may be 
read in quantity. 


Partly because large amounts of text cannot be 
shipped to the user, a little PROJECTOR is in the ter- 
minal. It uses a tiny microfiche, or microfilm sheet, 
small enough to fit in the palm of your hand, 


If a PLATO author deems it necessary, he requires 
for his lesson, not just the use of the keyboard and 
plasma screen, but microfiche as well. The student 
must put the microfiche in place when he starts the 
lesson; signals from Urbana (or wherever) then jump 
the projected image among 256 different images, in 
response to what the student does. 


Now, PLATO people are not doctrinaire about how 
their system is to be used. The plasma screen can be 
continuously showing little decorations along with 
the teaching material. The microfiche could be show- 
ing irrelevant works of art or travel scenes. These 
are all facilities at the option of the PLATO author; 
at his beck and call, if he thinks his program or 
lesson needs them. (But it's very bothersome to have 
the microfiche made-- an important difficulty.) 


Every terminal has the screen, the keyboard, 
and the projector. Other options may be added, how- 
ever: 

1. The touch panel, This is a transparent 
window that goes over the plasma screen 
and reports to the main computer whether 
it has been touched, and where. (This 
allows illiterates, especially kiddies, 
to use the system without typing.) 

2. The audio disk. This allows the termi- 
nal to respond with sound, including 
canned words, to the student. (It does 
not actually synthesize the sound, as 
discussed on p. DM{1.) 


3. The general jack. Not to be confused 
with Pershing, this is a connector 


socket that will send and receive data 
from any other device-- provided you've 
got the right interface. This allows 
all kinds of other devices, such as 
piano keyboards, to be used for student 


input. Or output (like gum-ball machines.) 


Actually, except for the restriction on quan- 
tities of material that can reach the student, PLATO 
is an extremely general system. Despite the strange 
convention of calling all user programs "lessons"; 
despite the odd stipulation that all users are called 
either "studerts" or"authors"; and despite being told 
by PLATO spokesmen that PLATO is not a general-purpose 
system; actually, it is. 


The hardware was designed by Bitzer. The soft- 
ware-- that is, the underlying computer part, never 
mind the contents to be shown (also regrettably called 
"software" by many hands— was initially less stressed 
by Bitzer, but eventually grew under the direction of 
others. In particular, an ex-biologist named Paul 
Tenczar (pron. "Tenzar'') created its underlying TUTOR 
language. (For an introduction to computer languages 
see p. IS and what comes after.) The TUTOR language 
exists only on PLATO; and PLATO authors may only use 
the TUTOR language, Paul Tenczar's creation. 


The TUTOR language can best be understood as 
a reaction to Coursewriter, another CAI language 
offered by IBM on its 1500 Instructional System, WI}. 
Coursewriter's original intent was ast 


to enable non-computer people, especially teachers, > book 


to create drill-and-practice instructional lessons 
roughly of the type porteolaws felled m 


LN 
Now, Johnny, what is 3X 5? 
Ww 


me 
Filled is Kits $10 No. 
asues (15 Good! J System replies. 


Obviously, by changing the numbers and pushing the 
kid on types of problems he hasn't mastered, the 
computer can patiently bring students to mastery of 
various simple skills, diagnosing weaknesses and 
stressing the individual student's problems. The 
difficulty is that attempting to extend this method 
out of the very simple has great pitfalls and may 
not even be worttwhile (see pp. )m I5-!4). 


Anyway, Coursewriter was promulgated by IBM 
with the 1500 and thus suffered premature standar- 
dization before things had been thought out. IBM 
is not to blame for Coursewriter's deficiancies, 
they were just trying to make a buck; but because 
a lot of scared people believed Coursewriter was 
the way it had to be, the evolutionary improvement 
usual for computer languages didn't have time to 
occur. An egregious omission: Coursewriter did not 
allow the author much access to the computer itself. 
That is, programs written for numerical calculation, 
say, could not be brought into instructional mater- 
ials at a sophisticated level. 


Tenczar's TUTOR changed all that. It has both 
the virtues and defects of being original. Apparently 
unlettered in computermen's controversies and dogma, 
Tenczar designed a language of great power and speed; il 
is utterly strange to computer people, offers various 
brilliant features, and is in some respects quite 
irritating. It looks very simple to the user-~ but 
beyond a few deceptively simple techniques, it has 
to be learned in considerable detail to do anything 
interesting. (See box, “L IF Retr to Toot ?") sext rage.) 


This tale has, of course, been simplified. Bit- 
zer and Tenczar did not work alone, but rather were 
leaders in a seething community of dozens of smart 
people working like blazes on the project. It has 
taken some fifteen years of Bitzer's effort, and tens 
of millions of dollars, to get the system where it is 
now-- Ready and Working. 


Project PLATO now extends far beyond its original 
domain. Originally a fairly tight nucleus at the 
Computer-Based Education Research Laboratory ("CERL") 
at the U. of Illinois in Urbana, the community of PLATO 
now sprawls out through its lines to a larger constit- 
uency, the PLATO community of users. 


(Indeed, this extended Republic of PLATO-- the 
systems people (gee p. Y&) in Urbana, the authors 
and locals-in-charge throughout the network-- consti- 
tute one of the maddest rookeries of computer freaks 
in the world. Where else would you find a 14-year-old 
systems programmer who's had his job for two years? 
Where else would you see people fall in love over the 
Talkamatic (a PLATO program which allows you to have 
written conversations with people at other terminals, 
wherever they may be) only to clash when at last 
they meet in person? Where else can you play so many 
different games with faraway strangers? (See Box.) 
Where else can students anywhere in the network sign 
into hundreds of different lessons in different sub- 
jects (most of them incomplete)? Where else are peo- 
ple working on various different programs for elemen- 
tary statistics, all to be offered on the same sys- 
tem?) 


PLATO is one of the wonders of the world. 


Mike O'Brien, a Tolkten fancter, has 
put the entire Elvtsh alphabet onto 
PLATO as a spectal character-set. 

Here the system gives a famous warning 
to turn back, both in English and 
Elvish. 

Mike says tt intimtdates snoopers 
poking around hts material. 


Unfortunately, there are so many learners, and 
so few PLATO terminals, that use of the terminals must 
now be fairly strictly controlled. (The eight terminals 
at the University of Illinois at Chicago Circle, at 
which most of these pictures were taken, generally work 
an eight-hour day.) The time was when people could 
just walk in, sit down at a terminal and do what they 
liked; now, sadly, each user must have an "account" 
and a password. 


But the rabble is howling at the gates. Many 
professors want to use it to take rote aspects of 
teaching off their backs; and the computer hums and 
students want to play the PLATO games (see box) and 
tinker with an interactive system of its power and 
lusciousness. But most of them will have to wait. 


PLATO's services are "free," for now. That is, 
if your school has PLATO terminals, and IF it will pay 
for the communications lines, THEN the services of 
the central computer are "free''-- the National Science 
Foundation is bankrolling its operation for a couple 
of years more. Then, bango, PLATO central service be- 
comes something that has to be paid for too. 


Just to give you an idea, the communication costs 
to Urbana for Circle Campus's eight terminals run at 
ever $10 ,000 a year. But these costs should be com- 
ing down sharply; it is the price of tooling up for 
whatever the PLATO future is going to be. Anyway, 
the general cost of the system comes out to about 
$1.50 an hour, the same as general time-sharing on a 
PDP-10 (see p. YZ). But that's without paying for 
the central.computer-- another cost which we expect 
to go down, however. 


Amongst the terminals, PLATO room, 
Circle Campus. What one person 
ts doting ordinarily has no bearing 
on the others, who could as well 
be tn Timbuktu as far as the main 
computer is concerned. 


This is all a far cry, of course, from Bitzer's 
claim a decade ago that PLATO terminals would cost 
only $400. But considering the system's success, we 
needn't dwell on that. 


Perhaps the real question is this: with man- 
machine intercourse of this quality now possible, 
can people's love for the system stay Platonic? 


Moonwar on a Saturday in Urbana. 
It's man-to-man among the craters; 
then a quick kill of the unknown 
adversary. 


And our doughty warrtor looks to the 
Big Board for more challengers. 
Kids love PLATO games. 


They work hard and they play hard on the mighty 
PLATO system. 


When the Author gets tired of Authoring, or the 
Student of Stewing, just around the corner, a few 
keystrokes away, are diversions and games to boggle 
the imagination. 

You can go to a program (''lesson rose'') and 
look at ''the great roses''-- elaborate curlicues gen- 
erated by mathematical patterns that appealed to the 
authors of that program; or. find, also tucked in rose, 
Conway's Game of Life (see writeup, p. 4% » and pict 


ture series, nearby). 


Then there are games you can play against the 
system, like racetrack and blackjack. (These games 
let you win astronomical sums of money-- play money, 
forgotten when you sign off.) Remember, of course, 
that you're not really playing against a computer but 
against a specific program, with its quirks and 


shortcuts and blind spots. 


Then there are games you play by yourself-- 
actually responding resources (see pp. dm )$-19), which 
entice you into trying things out. Tenczar himself 
has created two elegant, gem-like lessons, man and 
picto, which teach you computer programming without 
ever saying so. These two programs present the user 
with a tittle picture of a man on the screen, and 
show him hus the little man may be moved around and 
made to pick up pictures of balls. From there on 
the student may have his way-- and is never told that 
he's learning to program a true computer language. 
(Though it is a quite restricted one, dealing ex- 
clusively with little men and their excursions among 
balls and falling sticks.) 


Welcome to the Hop Game. 


Another charming game, | don't know by whom, is 
called candy factory. Here too the user may control 
the animation of the picture by what he types. Ma- 
chines are seen to manufacture candy, box it and 
ship it-- depending on what buttons you press. 


Some games are played between people who sit 
together before a single PLATO terminal, often with 
teaching intent. Such games include the hop game, 
where Bunny (you) and Frog (your friend) add their 
way. along a board with numbered squares. Older chil- 
dren can dig How the West Was (1+2)X 3, which involves 
grouping the numbers you get by chance to try to get 
ahead of the other stagecoach. 


THE ''BIG BOARD'' GAMES 


z Still another category of games, though, awaits 
the adult who craves real excitement. Because PLATO 
has so many terminals, all over, there is a curious 
combination of anonymity and intimacy between users 
(-- much like the curious Nonexistent Phone Numbers 
of Paris; in the French phone system, people calling 
the same nonexistent phone number can talk to each 
other; strange blindfolded encounters occur at the 
Number of The Day, spread by word-of-mouth; sometimes 
these result in people really getting together...)... 


Anyway, the Big Board games of PLATO have exac~- 
tly that: a shared list, or "Big Board,'' showing who 
is playing the specific game. 


But you don't have to use your right name. 


In-this jaunty society of shadows, you pick your 
own nom de guerre, or fighting name. This has nume 
erous advantages: the most obvious is that as you ime 
prove at play, you can shed the identity in which you 
have been humiliated. 


The main games with Big Boards are that old 
standby, spacewar (rocketships wheeling and firing 
at each other and sliding around on the screen); 
dogfight (biplanes wheeling and firing at each other 
and sliding around on the screen), moonwar (shooting 


Here tt ts Bunny's turn. Screen 
instructs you personally: 


PLATO often uses animated 
"Press -NEXT- to spin, ermtntrude 


opening titles. 


Pd Pal BUNNYs Turn 


The Navigation part of nova is 


DM 2") 


View from your Nova spaceship in- 
eludes perspective view of where 
you are among billions of stars; 
and your vartous controls. 


NOUA 


NOTICE 


already working. To get. around 
you need instruction; here we 
are at the Training Center. 


at the other guy by specified angles as you stand 
among craters). In addition, PLATO offers (not during 
working hours) what must be two of the most baroque 
space-war games anywhere, empire (eight races (the 
Vulcanians, Klingons, etc.) seek to control the gal~ 
axy) and nova (simulated navigation among millions of 
different stars and solar systems, all of which may 

be revisited, all of which are different...) 


People who only play PLATO games occasionally 
have to sign on. by typing their names into the big 
board. (They often get slaughtered by the regulars). 
The regulars-- hah. When they're signed into the 
system, they have merely to jump to a specific game 
for their fightin' names to be posted on the big 
board. A mighty rollcall they make, too-- such great 
warriors as yon Dave, zot, fright pilot, AL 9000, 
simpson, doc, THE RED BARON, The Red Sweater, The 


Giant Pud, Fodzilla, tigress, enema salad, Conan, 
» and EXORCIST. 


(As those insiders who have automatic sign-on 
to Big Boards write programs to do the sign-on, their 
arrival in a Big Board game is often an animated 


sigh-on. The cutest trick is THE RED BARON's: it looks 
like this. 

THE RED BARON x 1 plang folly us Flames | 
It:works like this. For dogfight, the terminal al- 


ready has stored in its temporary memory, as ''char- 
acters,'' the little pictures @f airplanes that are 

” going to buzz around the screen. So the Baron just 

i follows his name with the code for that special char- 
acter.) 


One last point. No longer can you sign on with 
an obscenity: a little obscenity-checking program 
looks for the usual expletives, in case visitors or 
other priggish folk might be looking. But of course 
this is easy to circumvent by putting periods between 
the letters of your nasty word, or something similarly 
deceptive to the poor program. 


THE KEY ROARD AND WHAT IT SORT oF 


THE StRucToORE OF PLATO -SPACE 


The PLATO keyboard. 
What looks odd and arbitrary to you is believed by devout Platonists 
to be divinely ordained. 


PLATO IV- STANDARD KEYBOARD 


EER ESESP UES SEAS a) -) |=" ~~) 
Bas werk gaae 
| ea CCS) | |] | 

BB MEMO | 


TO MOVE BETWEEN LESSONS, the basic actton is to hold down SHIFT and 
press STOP. (For further complications see Ins-And-Outs diagram.) 


TO MOVE WITHIN A LESSON, basic acttons are NEXT (to go forward or 
tell the system it's its turn; BACK, which sometimes returns you to 
earlier points in the sequence of your lesson; and six step-out-of-line 
options, by which the author may permit the user to stdestep to ex- 
planations, enrichment material, or things out of sequence. 


or 'FANTIC SPACE’ (see p- ). 


es, bet There Thay are, eae handy 


PLATO'S IMPLICIT STRUCTURE 
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The original idea was evidently that there would be a baste sequence, 
tn which NEXT and BACK would be the forward and back controls, and 
the other six would represent Help for the Confused, a "Lab" allowing 
experiments, and addittonal Data the student decides he needs. The 
three with Shifts simply provided a second option of each type. 


How the author might use these, however, was his own affair. 


"TERM" evidently was for when students wanted things Looked Up: by 
pressing TERM and typing the unknown word, the student would get a 
definition. "ANS" suggested that it might also be used when the 
student was allowed the optton of being told the answer, 


Note the arrows over Q,W,E,A,D,Z,X,C. They allow the student to move 
cursors, draw, point directions, etc. Unfortunate confuston ensues 
wtth the left-arrow on the far left, used tn programming (as in APL; 
see p. 22-3.) 


ERASE allows the student to correct his input; COPY helps edit and 
change things. SUP and SUB allow superscripts and subscripts; 
FONT MICRO ts like a spectal shtft key, going into whatever special 
font ts currently stored on the terminal. I have no inkling of what 
the little square means. 


IS IT BETTER To JooT ? 


"A tutor who tooted the flute 
Trted to tutor two tutors to toot. 
But he asked through hts snoot: 

ts tt better to toot 
Or to tutor two tutors to toot?" 


Folk thtng 


The TUTOR language grew out of drill-and- 
practice, for which it has a command specifying 
where a student's answer is to appear on the 
screen. This is the "arrow" command. The lan- 
guage has a strange scanning structure built 
around this "arrow" command, much as the TRAC 
Language (see pp. 18-21) has a scanning struc- 
ture built around parentheses and commas. Be- 
ginners don't need to understand the scan and 


‘ Ce 
the arrow command, but journeymen do. a ia, 


(Hon - standard 
1h 
TENCZAR'S CONCEPT OF A CONCEPT blac 


Much has been made of TUTOR's facility 
for "analyzing the content" of what students 
type in. Actually, of course, the computer 
does not "understand" what the student says 
(see "Artificial Intelligence,” pdm 12-1), 
but rather offers certain efficient tricks to 
the person using TUTOR to prepare presenta- 
tional materials. 


Basically, TUTOR's "concept" facility 
The technique of reduction (called a "hashing 
function") supposedly substitutes for any 
word of any language a code of 60 bits (see 
"Binary Patterns," p. 33), which means the 
program in TUTOR can rapidly test a student's 
input for numerous different possible things. 
(The power of this technique will be readily 
recognized by computer people; unfortunately 
there is no room to explain it further here.) 


Thus a TUTOR program may contain "concept 
searches" that test whether a student types 
either a desired response or numerous alter- 
natives. While it may be strange to call 
this a “concept," it is a powerful technique. 


Paul Tenczar's TUTOR language, the pro- 
gramming language inside PLATO, is like any 
other programming language (see pp. 15-31); 
intricate, and unlike its results. That is, 
a program bears no more resemblance to what 
it does than the word "cow" looks like a cow. 


PLATO is a system for canned presentations 
that respond to the student. Students need 
not know TUTOR. Anyone out to prepare such 
presentations must learn it, however; and the 
attempt has discouraged many. 


Tenczar is a former biologist, and had no 
preconceptions from computer orthodoxy to bind 
him in the design of TUTOR. Thus the lan- 
guage is very original. There is only room 
to raise the following points: 


To learn the first steps in TUTOR-- how 
to set up drill-and-practice lessons, for in- 
stance-- is unusually easy. 


To do anything complex, however, requires 
you to learn the bulk of the TUTOR language. 
Thus when people say TUTOR is "easy," they 
mean those first steps. 


TUTOR is not Extensible, like, say, TRAC 
Language (see pp. 18-19) or GRASS (see joni | Pe 
That is, a programmer cannot customize the 
language with new compound functions of his 
own making. Steps are being taken to correct 
this; meanwhile, it is said that the Urbana 
people can be persuaded to put in new commands 
others want for, e.g., chocolate chip cookies. 
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You can read the standard-size lettering off 
the screen at SIX FEET-- even though it's 
NO BIGGER THAN PICA TYPE. Fantastic. 

The internal circuitry that draws on the screen 
is highly capable. Receiving a 20-bit code, 
the terminal itself deciphers it as—- 


A LINE ON THE SCREEN, or 

TWO STANDARD CHARACTERS ON THE SCREEN 
from its FIXED character memory, or 

TWO SPECIAL CHARACTERS ON THE SCREEN 
from its CHANGEABLE character memory 
(which can be loaded with Russian, 
Armenian, katakana, Cherokee or what- 
ever~— even little pictures-—- at the 
start of the lesson), or 

A COMMAND TO THE MICROFICHE PROJECTOR, or 

A COMMAND TO THE AUDIO PLAYER, or 

A COMMAND TO WHATEVER'S IN THE GENERAL JACK. 


PLATO'S HANDY KEYBOARD ts on a 
flexible cable, can be worn 
in your lap. 


Note that all lines and characters for the plasma 
screen can be turned on (orange on black) or 
off (black on orange). 
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api j ‘ This is my reply to Bork's question, "Well, how would you do. ltr" 
WHAT THIS IS. I briefly visited Alfred Bork's CAI shop at the University of California 4 


at Irvine on a consulting basis. Bork is a really swell guy, but he's devoted to 
Dialogue CAI-- that is, to teaching programs that have pseudo-conversations 

with the student. (As I've said variously already, the pseudo-conversation parts 
are not only expensive and difficult, but sometimes irritating and objectionable; 
and happier, zippier, simpler techniques are available using various techniques of 
old-fashioned showmanship-- as from movie-making, writing and (here) the comic book. 


This ties into Bork's physics display system. That is, it's intended to be a front-end 
program (see p. 13) on a Tektronix graphics terminal (see p. DM7 and DM 20-23), 
leading into a simulation program (see p. 58) allowing the user to see all kinds of 
motions in physical law. The program it's intended to supplant uses dialogue. 


WHAT IT CONTAINS: introductory remarks; statement that physical law (as of motions) simply 
summarizes constant covariances. Sorry if readability is poor (Xerox of a Xerox). 


a 
No. 4 Var. 2 
No. 7. 
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Sues, of ATOMS? 
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You will note the artistic problem of composing cumulative animation for a display screen. 


Some people have accused me of trying to be humorous. Obviously nothing of the sort was 
intended. Research supported by NSF grant no. GJ296 (but "Mr. Natural" character 
property of Robert Crumb). 

«Homage to Robert Crumb. 
BIBLTOGRAPHY: for comic technique, study the works of Crumb; also, comicbook stands are 


currently featuring reprint magazines of THE SPIRIT, which is some of the finest stuff 
ever done. Also study Wally Wood in the early MADs. 


& Ws, 
CNV E Ro 


WIER-COMCS. "3 HIER-COMICS 72% 


ZB “NX 
SS / ; ee 

“(re-onl) | 

/ 


————— 


Fog mes rire > 


wed e & LT f 
About Cai) {hd ORR 
these d&7S5 -. oN 


COM TALK A LOT Agoor 
PANS ene Cmeses, Gor wie you REALLY IT's LIKE Things 
GET Wore IT, Its AS THOUEH TesTr GO TOGETHER. 5 . : . * Tuts 18 aun 
THERG Ahon'r ANY. THE AS Au A Per We Scant suns To vt peeer You GAN Seis 
THis 1S ALL A PLOT Te Ltr You ste THE AND Souam sysices~ eM ORE Tg HANGINARY Sued; 
/ BND Soran seyy cm 
tr you ste THE F ax re 
‘To wtr ¥ Laws oF . He Q - 


—. oF “se . 7, 4 2} s ; 9 ON apehie 
| < ate ¥ ; Wed 
l / A 

/ S 


Max 
GX 
A 


Poe |. on 
- 4 * . : 
On \y, : \ 3 
bo 4 : > 
NHEN THINGS 
THERE ane ACT TOGETHER, 
THINGS Haren Bovies vacthioy NETHER comes FIRST, 


fmov€ 
/T g LEGutre LAWS 
WwW saad UNWANEE eet, ut THESE 
TOOT HER + DIFSERENT Suse peseese 
WMsponls + 


THE CHANCES LET's BEGIN! 


TRAY RAINS? Do YoU WANT TWO STARS WITH YouR PLANET, 
OR ONE 
[aarwer heve] wey 


ORAY, HERS GOES —— 


O 
S. 7 


ASPECTS OF 
THE MOTN 
CHANGE 
TOGETYSR: 


SMSO 


THREE-DIMENSIONAL LINE DISPLAYS 


So far we've discussed the two-dimensional 
subroutining displays. However, things do not 
by any means stop there. A number of people 
in the early days experimented with techniques 
for drawing line pictures by program; the ear- 
liest of these used plotters, output devices that 
let the program draw with a pen. But interest 
soon grew in the possibility of interactive three- 
dimensional displays on screens. Johnson's 
Sketchpad 4 did this entirely by program. But 
as night follows day, people set about putting 
these techniques into hardware, creating devices 
that would automatically show things in three- 
dimensional views-- allowing the viewer to 
rotate views of nonexistent objects as if they 
were on unseen turntables. 


The views we are talking about, now, co 
sist of bright lines on a dark field, and so the 
"objects" we are talking about are called "wire- 
frame" objects-- they could effectively be made 
of welded wire. But now we do not have to 
build them physically to see them. 


Basically a three-dimensional system of 
this type stores the lines as coordinates in threes: 
endpoints of lines in a mythical three-dimensional 
space. Each point's location in the space is told 
by three numbers (example showing a house 
may be seen on p. ); a line in a space is 
represented in the data structure by two such 
points, and a code or something tying them to- 
gether. 


7\ 25, xs 


Actually Adage had a tremendous lead in 
this field, but they let it slip for some reason, 
and have now lost it to two firms: Evans and 
Sutherland on the high end, Vector General on 
the low end. (But of course things keep chan- 
ging.) 


The Evans and Sutherland Computer Com- 
pany was founded in 1966 by Ivan Sutherland, 
creator of the masterful Sketchpad system, and 
David Evans, chairman of computer science at 
the University of Utah. (For a time both held 
appointments at U2 at the same time, but now 
both have left the university to devote full time 
to their dream factory in Salt Lake City.) 


Their first product was an extraordinary 
piece of hardware called the LDS-1, which they 
said innocently stood for Line Drawing System. 
(To anybody from Utah, however, LDS means 
Latter-Day-Saint, and don't you forget it. Evans, 
indeed, is a Mormon, but I've been told it may 
have been Sutherland's sense of humor that 
chose the acronym.) 


It should be pointed out that a special ad- 
vantage of digital perspective calculation is that 
viewed coordinates can be read back by the com- 
puter, and serve as new data, if you go for 
that sort of thing. 
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The Adage Display is isometric, meaning 
that lines do not get shorter as they get farther 
away or longer as they get closer. While this 
is marvelously impressive, most people want 
real perspective; and it was this that Evans and 
Sutherland set about to make available in real 
time, i.e., in direct response to the viewer's 
actions. 


The LDS-1, weighing in at half a million 
dollars or so, buckled to the PDP-10, a big 
36-bit computer from DEC (see p. YO). Its 
view calculator worked symbolically (digitally), 
and thus could work to the higher precision 


INTERACTIVE ROTATION 


3D screens-- aside from their fun and excite- 
ment-- allow people to understand and work with 
complex 3D structures without having to build them 
physically. 


The understanding, however, comes from being 
able to turn and manipulate the structure on the 
screen. If you can't turn it you can't really 
perceive the 3D structure, because the arrangement 
of lines could be anything. 


However, systems like the Adage and the Vector 
General and the Evans and Sutherland devices allow 
you to turn things on the screen as easily as if 
they were on turntables behind a pane of glass. 


That's how you see, you see. 


This interaction is what makes computer dis- 
play augur a new era for mankind, if we're lucky. 
(It's also why we use the term computer display 
in this book, rather than "computer graphics," 
since people who make computers draw with pens are 
also doing "computer graphics"-- a related activity, 
but not one to change the world.) 


—\~——_\— 


UNFORTUNATELY, 
there is only room to discuss stick-figure 
graphic display here. But curved surfaces 


may also be depicted, though usually not inter- 
See below, and pp. D432 -4- 


actively. 


just to get through the basics, 


The computer, as penman, draws lines 
from a list stored in core memory. In a 
Sequence of ines three-dimensional system, the basic 
converte ‘Oo 
Screen coordinates (list of 3-D coordinates is converted 
to a list representing a particular 


necessary for true perspective calculation. 


Spatial data structure 


in 3-D coordinates calculation Among the exciting demonstrations that 


Ll 


view; the result looks 
like a wire frame. 


The second program follower in such a 
device behaves much as it does in the 2D system, 
but with certain additions. Like the 2D system, 
it proceeds down its own program one step at 
atime. Like the 2D system, it finds in its 
program the coordinates of a line to display and 
creates electronic signals representing its end- 
points. But it does not display these directly, 
since these are three-dimensional coordinates. 
Instead it routes these signals to what we may 
call a view calculator, a particular piece of hard- 
ware that has been primed with the angle from 
which you want to view the object. This view 
calculator, automatically and by mysterious means 
which vary among machines, produces the view, 
and its signals go to the screen. 


Let's say we want to display a point. The 
display's program follower pulls three numbers 
from its display list and notes the code that says 


you can see sitting at an LDS-1 are a map of 
the United States you can zoom in on, bringing 
you in to a map of New Jersey, then Atlantic 
City, then a specific intersection, all in one 
smooth continuous motion. Also a simulated 
landing on the flight deck of an aircraft carrier 
-- with you flying the airplane, so you can 

go over it, to the side, into the drink or straight 
at the carrier. In all cases the ghostly ship 
will move, turn and change perspective on the 
screen as if somehow it were really there. 


Several LDS-1s were sold. 


Meanwhile a little new firm of young guys 
in Southern California, Vector General, came up 
with a line of terminals like the Adage line, ex- 
cept that they could buckle to the 16-bit minicom- 
puter of your choice. (In practice most of them 
have been attached to PDP-11s; see p. 42.) 


The Vector General display is isometric, 
and makes its calculations in analog, like the 
Adage Display. It has been very successful a- 


Drawing by Ruth Weiss' BE VISION program, 
done at Bell Laboratories, mid-sixties. 
(© Walt Disney Productions.) 


This program represented truly curved 
surfaces in its data structure, as 
"quadric surfaces"-- that is, invol- 
ving powers of two in the math-- and 
calculated the visible lines tangent to 
the edges from the viewpoint, thus draw- 
ing the edges. Removing the hidden 
parts of the curves is of course one of 
the greatest problems. (From Ruth A. 
Weiss, "BE VISION." JACM Apr 66, 194- 
204, p. 201.% 
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Tinie tien aotieuke wide patie tan +a mong both universities and private corporations. f 
j oa ° : ° ia Oo te 
culator, already primed with the angle of rota- in addition , . highly anrerectNe pat wee OF pA h 
designed language is available for the creation . “i 


tion; and the view calculators figgers where on 
the screen that point should be displayed. The 
coordinates for the screen-- telling where the 
point goes in the desired picture-- go to the 
screen controller, and the point is brightened. 


How are these coordinates calculated? 
Well, some commercial units do it electronically 
("in analog") and some do it symbolically ("in 
digital"). The result is the same. 


df you want the equations for this, they're 
in the Newman and Sproull book.) 


Then how does the view calculator handle 
a line? Same thing. 


The program follower pulls three numbers 
from its display list and notes the code that says 
it's a.line, so it takes three more. Then the 
view coordinates of both points are calculated 
and fed to the screen controller. The screen 
controller now has two points on its screen-- 
so it draws a line between them. 


The first device of this type was, I think, 
the so-called Kludge (pron. "Klooj"~-- computer slang 
for a ridiculous machine, but in this case applied 
affectionately) built at MIT's Electronic Systems 
Laboratory in the early sixties. This device was 
a one-of-a-kind, built out of DEC circuit cards and 


of data structures representing 3D objects, as 
well as for general-purpose programming and the 
creation of whole environments. And it's free 

to individuals or companies that have Vector 
General displays attached to PDP-lls. (See 
"Coup de GRASS," p.5m3;.) 


But wait. Evans and Sutherland has now 


dropped the LDS-1 and given us-- no, not LDS-2, 


but something called The Picture System-- also 
built onto the PDP-11, but this one works sym- 
bolically (digitally) and in full perspective. The 
price starts at eighty grand. 


Since the Picture System works out of the 
PDP-11 core memory, the commands it follows 
are 16 bits long, since that's the size of a slot 
in PDP-11 core. But wait. They've designed 
the thing to convert to 36 bits, so that coordin- 
ates are moved to a private store or buffer be- 
tween the program follower and the display. 
This means the display can zoom and zip around 
in the scene without bothering the computer. 
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The rules of perspective have been under- 
stood since the Renaissance. In olden computer 
times (up till about 1965) people used to do 
three-dimensional view calculation by angles 
relative to a three-dimensional data structure. 
Then Larry Roberts at MIT noted that there was 
a more appropriate mathematical method, long 
moldering in obscure texts. The idea is ieee! 
easier to program. It's easier because it ser 
comes a simple matrix multiplication, which has 
no commonsense explanation but is important to 
mathematicians. 


SO that means that to calculate views of 
three-dimensional objects, the most usual way 
is now to add that extra dimension. Instead of 
having a point in space whose position is 36-24- 
36 (in some set of three-dimensional coordinates) , 
another arbitrary number is added to make it, 
say, 36-24-36-1. 


It seems that in the mathematics of multiple 
dimensions, it comes out simpler that way. In- 
deed, from a mathematical point of view the new 
improved dimension is just like the other three. 


For this reason, such an augmented system m of | 
coordinates is called homogeneous coordinates. 


hooking to a bigger machine. The ESL Kludge showed Pidtore. Bvf fer Like homogenized milk, the additional coordinate 
vividly how good it was to have instantaneous. view of is just stirred in with the rest, and out comes 
calculation under a user's control. The prefue Sole JUD your desired view calculation. (The formulas 


The first of these systems to be offered 
commercially, I believe, was the "Adage Display," 
made by Adage, Inc. of Boston, which used their 
unusual Ambilog computer (see p. 43) to rotate 
objects on the screen. I vaguely recall that it 
cost about $80,000 with computer but without ac- 
cessories. 


tr 4s fore d pido, viewashie 
mA roveble. 


Another important feature of The Picture 
System: it will do, not just ordinary perspective, 
out such weird view calculations as wideangle 
barrel distortion, pincushion distortion and 
Similar stuff. 


are to be found in Newman and Sproull, Princi- 
ples of Interactive Computer Graphics, McGraw, 
$15, your basic text on the subject.) 


At any rate the additional coordinate is 
often referred to, incorrectly, as the "homogen- 
eous coordinate." They're all homogeneous, 
which is why it works. 


Defauti#s Coup de GRACS 


Impudent and plucky Tom DeFanti was an assist- 
ant professor at 24. This in part because he has 
created one of the world's hottest 3D graphics lang- 
uages, which he calls GRASS. (He says it stands for 
GRAphics Symbiosis System-- also, he says, it Turns 
You On.) 


Tom's GRASS language is an excellent beginner's 
computer language for two reasons: first, it is easi- 
ly taught to beginners, and second, it is about things 
of interest to beginners, i.e., pictures and graphical 
manipulation on screens. (But compare the three be- 
ginners' languages presented briefly on pp. 16-25.) 


A prototype for the system was developed at Ohio 
State, on a project directed by artist Charles Csuri. 
Tom had a free hand, though, and the language design 
is his; but much of the specific coding was done by 
Gerry Moersdorf, and the graphics algorithms and ro- 
tation were programmed by Manfred Knemeyer. Inspira- 
tion was furnished by Maynard E. Sensenbrenner. 


GRASS runs on the PDP-1l, a splendid minicomputer 
(Tom's is shown on p. 36) and is specifically designed 
for the control of three-dimensional stick-figure dis- 
plays on the Vector General display system (see p. 

DM %O ). But a lot of people have wrestled with these 
matters and not done as well. Let's consider: 


1. ITS CLEAR SIMPLICITY. Tom believes computers 
are for everybody; he is not a high priest bent on mak- 
ing things obscure (see "Cybercrud," p. 8). Thus he 
made his language as sensible, clear and easy to learn 
as possible. Tom likes to stress the concept of "habit- 
ability" (a term of W.C.Watt), meaning the coziness of a 
system. 


2. ITS GENERALITY. Refining and condensing the 
basic ideas of a system is the hardest part of the de- 
sign. DeFanti made several interesting decisions. 


A. The intexnal form of the language is 
ASCII code (see p. GE ). In other words, you ¢3ah 
read programs in their final GRASS form. 


B. For a three-dimensional system such 
as the Vector General, the main form of data 
structure is the three-~dimensional object-- a 
list of points and lines in space. This is the 
form of data GRASS uses for most purposes. 

Cc. In the design of such a system you 
want larger 3D objects to be buildable out of 
smaller ones. This implies arranging data 
in tree structures (see p- 24). You also 
want to be able to make things do compound mo- 
tions on the screen-- for example, showing an 
airplane flying around on the screen with its 
propellor spinning; this too implies a tree struc 
ture. There are some programmers who would use 
different tree structures for both objects group- 
ed together and for movements grouped together; 
Tom uses one. 


D. Objects shown on Tom's system can also 
appear to move on complicated paths through three- 
dimensional space. In Tom's system, such a path is 
merely another object. It seems obvious when you 
say it, yet this kind of simple generality is ex- 
actly what many programmers seem to avoid. (Note: 
this facility is a generalization of Baecker's p- 
curve; see p.'m0S). 


E. Input devices are completely arbitrary and 
programmable. What happens on the screen can be con- 
trolled by anything-- any variable (see Pp. |G)" 
the programming language. In other words, DeFanti 
has decoupled the screen from any particular form of 
control, allowing user programs to make the connect- 
ion between controls and consequences. This means 
that, using Tom's language, it is comparatively easy 
to build complex custom controls for any function. 
(This is discussed under “Pantics,"% poet) 


F. The language has string functions that allow 
text handling. Since the language may also use con- 
versational terminals, it is eminently suited for 
"good-guy" interactive systems for naive users, as 
described on pp. 12-13. 


G. Tom's language is interpretive, like TRAC 
Language (see p. 30). That means it is “slow" in terms 
of the number of machine cycles required for it to do 
each operation. However, DeFanti has added a “com- 
pile" feature to the language, so that for long macros 
(sections of program) that have to run repetitively, more 
efficient compiled versions of the macros may be gene- 
rated. 


I coined the term fantics, for the art and technology of 
showing things, long before I ever heard of Tom DeFanti, 
and I am not about to change it just because he is now my 


friend and roommate. 


H. The language is extensible, meaning that the 
user may create new commands in the language as programs. 
These commands, however, may be used in later programs 
as if they were built into the language itself. 


I. The system is completely general-purpose. Many 
graphics languages are not, being restricted only to 
their original purpose. This is more difficult, but oh, 
so much more worthwhile. ; 


3. ITS DEEP GENERALITY. Things should be versatile, 
and able to be tied together in many different ways. This is 
what we mean by "generality;" and this kind of generality can 
make a system very powerful. (The term in mathematics is 
"elegance.") As is said on the other side of the book, com- 
plicatedness is not generality or goodness or power, but a 
sign of the designer's shallowness. 


Anyway, GRASS has this kind of generality. It has a 
great number of facilities, growing weekly, and they all tie 
together in clear and predictable ways, without exceptions. 
Rather than create special functions which cannot be tied to- 
gether, Young Doctor DeFanti has chosen instead to make the 
separate desirable functions part of a simple and clear lan- 
guage. (A note to you elegant types: GRASS is fully recursive. 
As a nice example, Dan Sandin (see p.5h &) wrote a program to 
display Peano lines that was under forty GRASS instructions 
long. It is also astonishingly reversible: you can watch it 
uncreate the Peano line, straightening itself backward.) 


In the more usual sense, DeFanti's language is not 
the 'most advanced'; there are more powerful 3D systems 
than the Vector General (the LDS-1l, see p.)m30, offers 
true perspective), more elegant user-level languages 
(see TRAC Language and APL, other side), true halftone 
(the Watkins Box); yet his achievement on close examina- 
tion is extraordinary. Never mind his age, the more eso- 
teric features of his system (full recursiveness, etc.) 
or the fact that he does not seem to have made one mis- 
take, which is infuriating. Consider only this: TOM DE- 
FANTI'S 'GRASS' LANGUAGE IS PERHAPS THE ONLY SYSTEM THAT 
CAN BE TAUGHT IN A FEW HOURS TO COMPUTER-NAIVE BEGINNERS 
THAT PERMITS FULL THREE-DIMENSIONAL ANIMATED INTERACTIVE 
GRAPHICS WITH TREE-STRUCTURED DATA. 


Tom DeFantt 


THREE WAYS OF SCCWG MOLECULES 


OING Bb COMPUTER DISPLES. 


Much of today's impetus for 3D computer 
display is coming from the field of chemistry. 
University chemistry departments are buying 
equipment like the Evans & Sutherland LDS-1, 


the Adage and the Vector General. 


Why? 


key features. And so on. 


Tom DeFantt. Shows part 
of hemoglobin molecyle. 

Data structure from 
Richard J. Feldmann, NIH. 


at Chicago Circle. 


Bouknight & Kelley (see p.DmsY) 


Because chemistry is increasingly invol- 
ved with complex three-dimensional structures. 
Crystals, long folding chain molecules, minus- 
cule forces acting on structures whose shape 
determines the outcome. Organic molecules 
that involve thousands of atoms, and whose 
complex folded structure exposes only certain 


The Vector General display illustrated 
here and there on these pages belongs to the 
Department of Chemistry, University of Illinois 


dm SL 


The best feature of all: it's currently available. 
PDP-11 owners-- even without Vector General displays-- 
may inquire of: Tom DeFanti, Doctor of Arts Program, UICC, 
Chicago IL 60680. 


You may wonder how a young bronking buck like DeFanti 
has managed to do such an excellent job, so elegantly, where 
so many have stumbled and falled? 


"I just learn from other people's mistakes,“ he says 
cheerily. 


Prof. DeFantt 
on the system. 


MISCELLANY : 


Coupling his system with that of Dan Sandin (p. DMY ) 
has created the "Circle Graphics Habitat," described on p. 


I hope I'm around long enough to write the GRASS lan- 
guage manual. 


(DeFanti's GRASS is an ideal language for something like 
the 3D Thinkertoy, described on pinss . However, it doesn't 
have any provision for the storage of large complex data 
structures, so the hard part would actually be working out an 
adequate storage data structure and storage macros within 
GRASS's use of the DEC file system.) 


SCREEN CONTROLS 


The great thing about CRT displays is that they can be 
used to control things by Manipulation of pictures, Instead 
of moving buttons or levers, you can seize parts of the pic- 
ture with the light-pen and move some part of the picture. 
The computer, sensing the choice or adjustment you have made, 
can then perform whatever operations you have directéd. 


Some samples: 
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The design of screen controls-- easy-to-use, clear and 
simple controls for everything-- is one of the frontiers of 
computer graphics. (See "Fantics," p.m 4351) 


DIMENSIONAL FLIP 


3D scopes are about the best we've got-- so what do 
we do about multidimensional phenomena? 


One very good solution is to show a selection of three 
dimensions at a time, and provide for easy "flip" from one 
dimension to another-- so that instead of looking at some- 
thing on demensions A, B and C you are looking at it on di- 
mensions A, B and X. 


For example, suppose you're a sociologist looking at 
measurements of various traits among a group of people. 
It's a cloud of dots in three dimensions-- whatever three 
dimensions you're looking at. Some could be: age, height, 
weight, sex, ethnic background, premarital experience, ed- 
ucation... etc. 


You view this cloud of dots, say, according to age, 
weight and ethnic background. That means you can rotate it 
around and see how many people in the group are what. 


Using dimensional flip, however, you can change the 
view as follows: rotate the box-frame till it becomes a 
square to your eye. Then you hit the control that makes 
the unseen dimension “flip" to another dimension that in- 
terests you. The cloud still looks the same-- until you 
rotate it, and the third dimension is now "premarital ex- 
perience." So you can quickly get a view of how popula- 
tions are really divided up. (Note to sociologists: this 
same operation, with stretching and clipping, provides a 
visual technique for "partialing" operations of the 
Lazarsfeld type.) 
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THE TWISTED SMILE FLIC COMPLETED 
You can make a character change expression on a 3D 

scope by making his mouth a twisted wire that can be 

rotated between "frown" and "smile" positions. The 

trick is the shape of the wire. 
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NOW GUESS WHAT: DeFanti's GRASS language is the best lan- 
guage I know of for doing all the above things. 
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COMPUTER HACFIONE IMAGE SYSTEMS. sorsce. 


A Series of Review Articles for 
Computer Decisions Magazine. 


WHERE TO GET IT. 


from a variety of sources. 


Computer 3D halftone systems are now available to moviemakers 
It tends to cost a lot of money, but 
when compared with normal Hollywood production expenses, it turns 


out not to be so bad. 


SALES OF MACHINES. 


Computer Image Corporation, Denver, 


for sale. See p. DM 39. 


Evans and Sutherland Computer Corporation, Salt Lake City, 
offers the Watkins Box, a real-time display device 
using the Watkins Method (see next page) and offering 
also Gouraud pseudo-curved shading (see p. DM Bros 
It costs about $500,000 and attaches to a PDP-10 


large computer; see p. 40). 


FIRST ARTICLE 
General idea of 3-D halftone. 


Polygon Systems. 


halftone image 
synthesis 


by Theodor H. Nelson 
The Nelson Organization 


To most people in the computer field, “computer 
graphics” means line drawing—systems and programs 
for mapmaking, pipe layout, automobile and aircraft 
design, or any other activity where a diagram may 
help. Using line-drawing programs and equipment, 
designers may create line drawings on fast-responding 
graphic screens, reworking their ideas until satisfied; 
the system then disgorges polished drawings and speci- 
fications for the designer’s real intent, something else 
that is to be made or done. But it is possible for a 
picture itself—instructive, interesting or pretty—to be 
the goal. In that case we will often want pictures that 
look like things instead of wires. A picture that is not 
all black and white we call “halftone.” 

With much secrecy and a slow start, computer 
halftone systems are now being built all over. The 
methods are extremely different from one another; 
only the outputs are similar. Some exist in software, 
some have already been built into special hardware. 


Computer graphics the ordinary way 
The computer, as penman, draws lines 
from a list stored in core memory. In a 
three-dimensional system, the basic 
list of 3-D coordinates is converted 
to a list representing a particular 
view; the result looks 

like a wire frame. 


Spatial data structure 
in 3-D coordinates 
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General Electric, Syracuse, offers three-dimensional scene 
synthesis like that at the bottom of this page. Every 
job is custom. it's done on videotape through programs 
running on a smallish computer. Production costs, 
after your data structures are all in, could run as 
little as hundreds of dollars per minute (rather than 
thousands). 

Contact: Charles P. Venus, General Electric Co., 
Building 3, Syracuse NY 13201, 315/456-3552. (Given 
in detail because harder to reach than these others.) 

Computer Visuals, Inc., Elmsford, NY. Offer more detail 
than GE system, and go straight to film without video. 
More expensive: probable costs run in the thousands of 
dollars per minute. Again, every job is custom, 

Contact: Nat C. Myers, president. 

Dolphin Productions, NYC, has several Computer Image machines, 
but their president, Allen Stanley, is interested in 
everything. 

Computer Image Corp., Denver and Hollywood, also offers services 
on their machines. On occasion they have been willing 
to back film-makers, reportedly on a 50-50 basis. Their 
president, Lee Harrison III, is a swell fella. 


offers various systems 


Here are the methods 


Gary Watkins, U. of Utah 


of the ‘polygon school. 


Author's note. These articles were 
written for Computer Decisions magazine, and 
reflect the results of a lot of phone calls they 
paid for. The first of these articles was pub- 
lished in 1971. The others have not been 


_previously published, as the editors and I 


were never able to get together on quite what 
they wanted. 


This is, to my knowledge, the only 
existing collection and summary of computer 
half-tone systems to date, and in some cases 
the articles reveal more about the systems 
than has been published anywhere. Sur- 
prisingly, even two years later they do not 
seem out of date. 


However, due to the editorial style of 
Computer Decisions, and my own, this has all 
come out extremely condensed, and phrased 
in breezy and humorous ways not ordinarily 
considered acceptable for serious technical 
reviews. The hope is that they will supply 
orientation to the browser, deeper insights to 
the technically-minded, and further directions 
for them as wants to pursue. 


My thanks to the publishers of Computer 
Decisions and its editor, Robert C. Haavind, 
for their encouragement, phone money and 
permission to reprint this. 


There are more ways than one 
to produce shaded pictures with computers, 


These systems have many potential uses for visualiza- 
tion, animation and new kinds of photography, in 
art, scholarship, motion pictures and TV; for visual- 
izing worlds lost and imagined, equipment yet unbuilt, 
the responsiveness of aircraft. It may not be long 
until moviemakers can buy different brands of picture 
synthesizer, just as musicians choose today among 
Moog, Buchla and ARP music synthesizers. But none 
is in production yet. This is an attempt to review the 
coming apparatuses of apparition. 

Not only is the field of halftone one of the most 
exciting in computing; it is also one of the nuttiest and 
most secretive. For instance, at one time a firm that 
was supposedly marketing its halftone system declared 
the present author persona non grata and not to be 
communicated with in any way, though information 
was freely available to others. “I don’t think it’s 
necessarily paranoia,” says Rod Rougelot of General 
Electric. “A lot of guys started about the same time, 
and proceeded in a heads-down manner.” It took a 
special kind of initiative to head off in that direction 
with no external provocation. “All those heavy cats 


(20, 25, 40) 


Sequence of lines 
converted to 


calculation screen coordinates 


COMPUTER DECISIONS 


from ARPA and MIT were saying in the sixties I could 
never do a Mickey Mouse,” says Lee Harrison 11 of 
Computer Image. “But I’m not that kind of researcher. 
I talk to the Lord.” 

The systems’ stories are as different as the systems 
themselves. General Electric’s system grew out of 
cockpit displays for blind flying. The system of Penn- 
sylvania Research Associates began with terrain and 
radar modelling. The system of MAGI (Mathematical 
Applications Group, Inc.) began with the study of 
radiation hazards in battlefield machinery. Two system 
families, that of Computer Image Inc. and my own 
Fantasm, were designed from the beginning for movie- 
making, especially “special effects” and puppeteering. 
The most poignant tale may be that of Lee Harrison, 
whose struggling family was warmed through cold 
winters by the tubes of their analog computer. 


Halftones in two dimensions 

Two-dimensional computer halftone is not new. 
Halftone pictures converted from photographs have 
often been printed out on line printers, either for fun 
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MAY 1971 


General Electric will make movies and videotapes for you with their pictorial synthesis 


system. 


These are from a beautiful (really beautiful) film they did for NASA, 


The point of 


the film was to explain to everybody how a proposed space laboratory would be'built and would 


function. 


After hitting 
LS paint on a surface, 


(nudes often turn up at big installations), or in con- 
nection with some scientific problem, such as analyzing 
chromosomes. Kenneth C. Knowlton, 4t Bell Labora- 
tories, has executed some well-known photo conver- 
sions making pictures into huge grids of tiny whimsical 
symbols having different grey-values. ; 

Various other systems have allowed users to create 
their own original 2-D pictures. But the natural temp- 
tation is to want the computer really to make pictures. 
Why not have the computer produce a photographic 
picture directly from the 3-D representation of objects? 
Computers don’t do this by nature, any more than 
they do anything else by nature, so how it may be 
done by computer is very interesting. The problem is 
also interesting because of its intuitive nature. Visions 
of scenes in space are around us constantly, and we 
intuitively understand the geometry of outlines and 
light. As 3-D work progresses large problems are being 
overcome. The famed “hidden line problem,” .for ex- 
ample, was misleadingly couched, since the problem 
is not finding what lines are hidden, but what surfaces 
are in front! 


3-D halftone system 

Today's new procedures can use the 
same data to make a realistic shaded 
or halftone picture. The visible parts 
of the objects are ascertained by 

what color is it? programs or special hardware, 
using the same 3-D coordinates as in 

ds structure the ordinary systems. These visible 
a parts are then shaded according 
to the appropriate color information. 
The series of shading-points makes the 
picture on an output device. 


Spatial d. 
in3-Dc 
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Rather than use diagrams, they enacted it in the GE system, so viewers could under- 


stand how the sections would be delivered and fit together, how the antennas would unfold and 


so on. 


For exposition of that kind, nothing beats this kind of enactment, 


We must draw on this understanding of scenes to 
figure out how to make pictures, for there is no 
mathematically elegant or preferable approach. Scenes 
are geometrically rich, and thus many different tech- 
niques may be used to extract pictures from them. 
These techniques may look at planar structures, spatial 
interconnections, relative edges of intersections or 
anything else you can define and process. I prefer to 
think of computer halftone as like trick photography 
of the kind done in Hollywood: a variety of tech- 
niques can be combined in various ways. As in trick 
photography, the number of touches and enhance- 
ments that you add generally determines how good 
it will look, regardless of what system you begin with. 

The simplest systems are those that depict objects 
made of polygons—that is, planes with straight edges. 
We will discuss such systems in the present installment. 


The wild polygon yonder 


At least two companies are building image systems 
that will behave and respond like onrushing reality, 
Such a system, hooked to cockpit-like controls, can 
show a trainee pilot the delicate and precipitous results 
of what he does. Realistic action, rather than surface 
detail, is crucial. 

The techniques of action polygon halftone were 
originally developed by General Electric, of Syracuse, 
N.Y., and are now also under development at Link 
Division of Singer Company (makers of the beloved 
pilot trainer and its progeny). Basically such systems 
operate upon the scan-lines that crisscross a television 
screen, switching the color of the running scan as it 
crosses from polygon to polygon. 

The action polygon school—GE and Link—takes 
a curious but effective approach to halftone TV: their 
“environments” are composed entirely of convex objects 
made entirely of convex polygons. To use only convex 
objects (no dents) means that one object may be in 
front of another or vice versa, but never both. (An 
object with apparent indentations, such as an airplane, 
has to be made out of a group of convex objects flying 
together.) To use only convex polygons (notchless) 
makes it easy for the system to decide, at a given 
instant, whether the scan is crossing the polygon or not. 


Instantaneous enactment: halftone animation 


gives a sense of really being there. (Rod Rougelot, 
General Electric) 


This work evolved in part from GE’s work in the 
fifties with a “ground plane simulator,” a system that 
would show a correct representation of the ground’s 
position, dipping and rotating, to the pilot of an air- 
craft in fog or night. In 1963 the General Electric 
group, under Rod Rougelot, worked out for Nasa the 
design of an “environment simulator”—a device that 
would simulate the appearance and performance of 
any equipment. This is now called the “old NASA sys- 
tem.” It permitted the user—seated before a color TV 
screen—to work controls for an imaginary aircraft or 
spacecraft, and see roughly what the pilot of the craft 
would see, flying in real time through a breathtaking 
color scene. Films made on this machine have been 
stunning. Imaginary cities, roller coasters and aerial 
dogfights are among the visions that can be presented. 

General Electric’s old NASA method is fairly weird 


The edge-box reports summed into the facet boxes, 
each of which was set to respond to a particular 
combination of left-right, above-below reports. At the 
instant all the facet’s edge boxes replied in the proper 
preset combination, the facet box signalled that its 
own facet was being crossed by the scan-line. When 
more than one facet-box responded, the one nearest 
the viewpoint had its color gated to the screen. 

Now Rougelot’s group is replacing the old NASA 
system by a new NASA system, which works on entirely 
different principles, but keeps the vector calculator. 
The old one could show scenes with up to 240 edges; 
the new NASA system will at least double that. GE’s new 
method is already operational on smaller research fa- 
cilities. They don’t tell what it is, but basically it in- 
volves sorting by distance. Supposedly the sort method 
is good enough to make the old edge boxes obsolete. 

The Link group claims competitive performance for 
their system, which will go to black-and-white thou- 
sand-line TV. They say their system is different, better, 
and secret. 


Campus of Fooled U. (GE) 


Wylie-Romney: shoot the works 


The Wylie-Romney method, disclosed in 1967, was 
the first generally publicized procedure for making 
halftone pictures. Indeed, the 1967 publication sig- 
nalled the explosion of the University of Utah into 
the forefront of computing research. 

The Wylie-Romney method was actually the joint 
work of Chris Wylie, Gordon Romney, David C. Evans 
and Alan Erdahl; but much of the impetus for its 
development came from Evans, chairman of computer 
sciences at Utah, who had long suspected the possibil- 
ity of 3-D halftone synthesis. 


Halftone for art’s sake: now the artist can create 
worlds and photograph them. (Gordon Romney, 
Utah) 


Sms 


Movie sets, TV effects: computer halftone is - 
‘eady to compete. (Gary Watkins, Utah) 


The method of Gary Watkins is the result of a 
profound search at the University of Utah for the. 
method—a polygon technique fast enough for real- 
time enactment, but cheaper than the GE-type systems 
and not subject to the convexity restrictions. They seem 
to have found it. 

Each video scan of the scene results in a “slice” 
through surfaces.in the scene. The two nearest surfaces 
are continuously compared to see which is closer, as 
if by two rulers. The instant a new surface becomes the 
nearer one, the system makes it the visible one. The 
nearest surface always shows, down to the precise 
instant two surfaces cross. 


Watkins method: A new nearest surface is 
instantly sensed through continuous comparison 
of the closest two. 


NOW AVAILABLE! Machine running Watkins 
technique, the Watkins Box, allows 
you to view tmaginary objects in ; 
color and manipulate them in real time. 
See top of preceding page. 


(Note: more output by 
various Utah systems 
appear on following pages.) 


if not mischievous. The earlier “ground plane simu- 
lator” had shown.an-edge (the horizon) digitally dis- 
played on a crt; the system was extended to many 
edges, and the logical analysis of areas between them. 


The scene was represented by a collection of edge 
boxes, physically jumpered into a collection of facet 
boxes. Each edge box and facet box was loaded with 
certain numerical and logic values, representing edges 
and facets in the scene, which could change between 
frames as required by the action. 

In the preprocess for each frame the old NASA sys- 
tem used a specially built digital computer, the “vec- 
tor calculator.” This performed at great speed the 
three-part vector calculations necessary to determine 
all scene positions, including the positions and slants 
of all edges. Each individual edge generator, loaded 
with its own edge position, constantly reported whether 
the running scan of the picture was to the left or right 
of its own edge. It dutifully guarded this edge from 
border to border of the picture. 
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“Old NASA’ method: Each edge box constantly 
reports which side of its edge the scan is on; 
each facet box sums the edge reports to sense 
when the scan is crossing it. 


The Wylie-Romney method is this: for each picture- 
point desired in the final picture, shoot a searching 
ray through the scene at a corresponding angle. Find 
where this searching ray hits every surface in its way. 

Since the locations in space of these hit-points are 
easily calculated, figure their distances from the vantage 
point. The nearest of the intersections is the visible 
one. Look up the color of that surface and shade the 
output point accordingly. 

This may sound inefficient, but it is comparatively 
easy to ascertain all the piercing-points, since the sur- 
faces to be hit in a given scanning row can be largely 
predicted from the previous row. 


John Warnock’s method, also from Utah, is unre- 
lated to the other methods, but has qualities mathe- 


maticians like, as well as a certain whimsy. 

Consider a square in the picture area. (At the start 
consider the whole picture area.) Now then. Test 
whether the present square is entirely filled with one 
color. If so, output a corresponding square all of that 
color. If the present square is not all one color, divide 
it into four smaller squares. Take another square and 
go back to Now then. End the process when each of 
the squares in the broken-down picture has been 
completely filled with one color—or the unsatisfied 
squares are too small to care about. 
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Warnock's dicing method: What can't be made all 
one color is redivided till its pieces can be. 


Shading: Last of the great fudge-functions 


Suppose that we have some data structure represent- 
ing a three-dimensional object, and a halftone method 
to search out its visible surfaces. How do we shade the 
output points? What do we take into account: how 
combine the basic greys or colors, how blend them 
with computations of surface angle, distances from the 
vantage point, or anything else we can think of? 

The answer: any way at all. The combining function 
is an aesthetic choice. There are not many areas left 
where you can make up a mathematical hodge-podge 
and get pleasing or interesting results. Computer half- 
tone is a felicitous exception: you can augment by 
adding or multiplying, diminish by subtracting or divid- 
ing, and yet always come up with an image resembling 
something. Anyone who has worked in a darkroom 
will recognize that this is like enlarging: playing with 
parameters won’t obliterate the picture. 

There are purists who insist that halftone coloration 
should exactly follow the formulas that simulate the 
behavior of real light. For some purposes, like pilot 
training, this may often be-true. But insisting on mathe- 
matical accuracy as a general principle is like insisting 
on ultra-high fidelity—an aesthetic: judgment couched 
as a mechanical imperative. . 

Until now the output hardware was not really ready 
for halftone. Five years ago a computer could usually 
create halftone pictures only on a line printer or a 
4020 microfilm plotter. Today there are many different 
photographic printers, going to all sizes of film and 
paper; one even uses a laser. There are various display 
terminals permitting grey-scale and color halftone on 
TV screens. 

The age of computer image synthesis has begun. 
Polygon systems are fast and simple, and will come 
to be used in our daily lives for such diverse purposes 
as molecule study, the memorization of delivery routes, 
and visualization of every kind of layout and design. 
They will be fundamental to our: new world of 
computer display. O 
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SECOND ARTICLE. 


Surface patterns. 
Curvature. 


Shadow. 


THE PLOT SO FAR. 


Various computer methods now make it 


possible to create artificial photographs of E 
three-dimensional objects or scenes represented © / | | 
in the computer's storage. This is done by 


coloring or shading points in an output picture 
like the points in the scene that can be sighted 
through them from the vantage point. What 
the methods really boil down to, though, are 
searching processes in the data representation 
of the three-dimensional scene. 


In an earlier article we have considered 
some of the techniques being used to depict 
simple scenes-- those made up of polygons. 

Now we turn to more elaborate scenes which add 
Shadows, surface patterns and curvature. 


. One of the most interesting things about VARIOUS NEW TECHNIQUES PERMIT US TO ADD CURVES, 
this branch of computer graphics-- already seen SHADOWS AND SURFACE PATTERNS 
in the polygon methods discussed earlier-- is TO COMPUTER-GENERATED HALFTONE PICTURES 


the variety of techniques that can be employed. 
Moreover, these methods, for all their sophisti- 
cation, can usually be intuitively understood 

as thought they were operations performed on 
objects in space. The same continues to be true 


for the more complex systems. ENHANCED POLYGON SYSTEMS 


In the methods discussed so far, we looked 
at several computer techniques for photograph- 
ically depicting scenes and objects made up of 
polygons-- planar facets-- in a represented 
three-dimensional scene. Imaginary houses of 
cards, cardboard airplanes and triangular scen- 
ery take on a compelling vividness when depicted 
by the computer. And for visualizing such 
things as architectural arrangements, such 
systems promise to be of increasing practical 
value. 


Those of us interested in the artistic 
aspects of computer halftone images want more. 
This article looks at some ways to add the 
appearance of curvature and surface pattern 
to computer-synthesized images. 


MAGNUSKI'S CONSTRUCTIONS OF REPEATED PATTERNS 


(different perspective calculations) 


Basic triangle pattern... is stitched together 
in adjacent positions 
at appropriate angles. 


MAGNUSKI'S PATTERNED CONSTRUCTIONS 


A number of contributions have been made 
by individuals working alone. For instance, 
Henry Magnuski, at M.I.T., created a program 
that repeatedly positions patterned facets in 
space to make large constructions. 


This program did not calculate "true" 
shadow, basing its shading partly on angle of 
surfaces. Neither does it show true curves. 
Yet it shows the impressive degree to which 
such effects may be approximated. The result- 
ing beach ball picture is reminiscent of Moorish 
architecture. 
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BOUKNIGHT AND KELLEY: 
PICKING THROUGH A CAT'S CRADLE 


The method of Bouknight and Kelley, at 
the University of Illinois, permits the addition 
of shadow to polygon pictures. Their method 
uses an intricate system of scanning sweeps 
across the scene, analyzing the successive edge- 
crossings. For each output line, a list of the 
edges in the scene is ordered according to which 
will be next encountered. To make a specific 
output line of shaded points, we step through 
successive positions of the scan-line, until an 
an edge is crossed. With each edge we cross, 
we enter or leave at least one facet. Of all 
the current facets we are in after a given edge- 
crossing, the system finds out the nearest one, 
the visible one, by comparing distances. The 
coloration of this facet is then fed out to the 
picture, until the next edge-crossing. 


Bouknight and Kelley expand their method 
to show shadows by an additional step. They 
create a new list of edges to be encountered, 
this one relative to scans from the light source. 
Then, during the regular output picture scan, 
they look to this latter data to see about shadow. 
As soon as they know two consecutive edges 
of a visible object in the picture, they are able 
to search the shadow-edge list to see if any 
shadow-edges impinge between them. The final 
list of edges-- visible facet edges and shadow 
edges-- goes to the picture output device. 


BOUKNIGHT-KELLEY METHOD 


Consider the series of edges whose 
projections cross the current scan-line, 
Each time the scan-line crosses an edge, 
find out what facets are currently pierced 
by a sight-line from the viewpoint. The 
nearest of these facets is the visible one. 


To add shadow, use an extra list of 
the scene's edges relative to the light 
rather than the camera. Between viewed 
edges, check for shadow-edges as well. 


DON LEE FILLS IN THE GAPS 


Don Lee, at the University of Illinois, 
produced his fine-toned pictures of spheres in 
1966 simply because someone bet him a quarter 
he couldn't program the method he'd suggested 
in twenty-four hours. He almost made it. He 
made his pictures of spheres and polygons by 
calculating the boundaries, then checking for 
overlap and filling in with greys according to 
viewing angle. His program works only in 
special cases, but is interesting for its historical 
position; it was one of the earliest half-tone 
curvature systems. 


HAVE A BALL WITH DON LEE. 


Then fills in 
curvaceous 
shading. 


His program first works out 
the general outlines. 
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SIMPLEX CURVATURE SYSTEMS: MAHL & MAGI 


A fundamental type of system we may call 
the "simplex" system was exemplified in the 
previous article by the Wylie-Romney program. 
A simplex technique simply projects simulated 
rays toward the scene from the vantage point 
till they hit the represented objects, and fills 
corresponding positions on the output picture 
with the colors encountered on the front surfaces 
of objects in the scene. 


The same principle extends naturally to 
scenes with curved and otherwise embellished 
objects. 


Robert Mahl, at the University of Utah, 
has recently reported his results with simplex 
methods using quadric surfaces-- those curved 
surfaces generated by mathematical powers of 
two. His pictures-- like the cup and saucer 
shown here-- have a pleasing 1920s Bauhaus- 
like quality. 


One problem with this method is that 
computational complexity increases rapidly as 
the scenes grow more complex; the more surfaces 
and piercing-points, the more time-consuming 
(and expensive) it becomes to make the picture. 


MAHL'S SIMPLEX METHOD 


VS Calculate all intersections of sighting ray 
with objects in scene; calculate which 


\earyory is nearer; shade it according to angle. 
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It seems, however, that Mahl's work may 
only be a rediscovery of what one organization 
worked out earlier and is being secretive about. 
A firm delightfully called MAGI (Mathematical 


Applications Group, Inc.) of Elmsford, N.Y., MAGI program was originally developed 
a has extended the same idea more elaborately. for study of radiation hazards inside 
They happened into the halftone game through military armor; the pseudo-photographic 


techniques were a side effect of the 


approach chosen. Who know: , these 
MAGI's system, now thoroughly developed tanks may be the ones studied. 


under Robert Goldstein, began in 1965 in a study 
of radiation hazards in battlefield equipment. 
They wrote a program to simulate paths of radia- 
tion, say, that might reach a tank driver under 
varous disagreeable circumstances. Having 
written a program that would ascertain the sus- 
ceptibility to radiation of battlefield machinery, - 
they noted that the same program could be 
adapted to making photographs. The progam 
simulated radiation; light is radiation; ipso 
facto, pictures. Substantially the same program 
would make photograph-like images, by treating 
the objects as opaque, and reflecting different 
shades according to color and angle of view. 


a military contract. 


Dd ots 


The resulting system makes nice pictures 
of objects composed of planes and quadric sur- 
faces; and includes, as will be seen from the 
racing car and chair, colored surface designs, 
shadows and spectral reflections. Not only does 
MAGI's software for this process produce deli- 
cately shaded pictures; if the virtual picture- 
plane is moved until it intersects the subject, 
it produces a cross-section. 


MAGI techniques were used to study 
alternative ways of lighting mines. 


MAGI runs this program remotely in 
Fortran on a big computer-- but they have their 
own minicomputer setup for photographing the 
results as color movies. They now offer use of 
this system commercially for making movies or 
stills. 


Lalas 


Enlargement from MAGI film. I hape 

the reproduction shows the concentric 
rings, called Mach bands, that divide 
areas of shading; Knowlton and Harmon 
(citation p. DM 10) advise on pseudo- 
random techniques for correcting this. 


SYNTHEVISION SETUP uses remote time-sharing computer, 
running big secret Fortran program and containing 
entire data structure of three-dimensional scenes. 
Minicomputer photographic setup is on premises at 
Computer Visuals, Inc., MAGI subsidiary marketing 

the Synthevision service. 


Local setup uses Nova minicomputer controlling both 

CRT display and camera. Informed guess would sug- 

gest that time-sharing system does not send all 

successive points of output line, but difference 

and transition values; Nova program would then in- ROUNDUP 
terpolate gradations in relatively quiet sections 


of the scan-line. These have been some of the highlights 


of the halftone game to date. The methods des- 
cribed so far are mainly software-oriented, and 


MAGI's precise system is secret. However, the only 
real questions boil down to: forms of surface rep- 


resentation; systems of scene sorting; and method for the most part work most efficiently as pro- 
of scene scanning to produce output scan. grams. In the next article we will look at some 

An early MAGI: character. outlandish new forms of equipment, under con- 
Note that one of the most impressive things about struction or proposed, for dedicated production 
MAGI work, at least for sophisticates, ie the. de= of 3-D halftone pictures. 


gree of artistic control that seems to have been 
realized in their input and revision systems. It 
seems they offer excellent control over motion and 
color, and, of course, revision of the action in 

a scene till the maker is satisfied. 


eP| Popular Science, I think it was, had a spread on 


Pee pe ee es a. a eS —— 37 fy 


THIRD ARTICLE. 


SPECIAL EQUIPMENT IS NOW BEING BUILT 


FOR MAKING "REALISTIC" HALFTONE 


PICTURES BY COMPUTER. THIS ARTICLE 


COVERS SOME OF THE MORE UNUSUAL 
HALFTONE HARDWARE SYSTEMS NOW IN 
EXISTENCE OR BEING PLANNED. 


ARDENING- 


OF THE ACTISTRIES 


HARD TIMES A'COMIN 


In two previous articles we have summar- 
ized some of the important basic techniques in 
computer halftone-- the artificial construction by 
computer of photographic pictures of 3-D scenes, 
scenes which are represented within the computer 
as colored or shaded surfaces placed in a coor- 
dinate system of three dimensions. 


I suggested this cover 

for this article. The 
folks at Computer Decisions 
reacted with puzzlement 

if not dismay. "This cover 
doesn't have practical 
applications for the 


average user," I think 
someone said. 


GOURAUD'S TWIST adds the appearance of 
curvature to a faceted object shown opaquely 
by the Watkins method (described in first 
article). 


Instead of shading each point within a facet 
with the same color, interpolate between the 
vertex-colors according to how far down the 
edges you've gotten. Note that the jagged 
edges are retained. 


Specialized hardware systems. 
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Results of Gouraud's swell smoothing technique. Mme. Gouraud posed 

for the data structure on the left, a system of interconnected .flat polygons. 
The Gouraud process (see box below) created the smooth-looking face 
from it by an extremely simple process. (Note that the power of the 
technique is in the use of a simple polygon data structure, rather than 
the more difficult truly-curved surfaces used, e.g., by MAGI.) 

(Note also that the edges remain jagged.) 


The techniques we have looked at were 
all intuitively "spatial" in character, having to 
do with the analysis of sight-lines and relative 
edge positions, and suited to implementation in 
computer software. Now we turn to some more 
advanced and peculiar techniques and equipment 
intended to make 3-D computer halftone faster 
to use, or more realistic, or easier to work with, 
or cheaper. These systems represent a coming 
generation of*halftone hardware. 
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THE WATKINS BOX 


The University of Utah is now building 
what wil be for some time the world's most 
spectacular interactive computer display, the 
Watkins Box. This device, interfacing between 
a computer and a television screen, will carry 
out the Watkins algorithm (described in the 
first article of this series) in real time: ripping 
through a predigested list of facet information, 
the Watkins Box will create on the screen an 
image of an opaque object which the user can 
rotate or see manipulated by program. 


The Watkins Box can operate in two modes: 
normal mode, in which the object appears faceted, 
and Gouraud mode, in which it appears to be 
curved over (see masks, nearby). 


The Gouraud algorithm, developed by a 
graduate student of that name, is a ridiculously 
simple technique which marries perfectly to the 
Watkins method. Instead of shading the facets 
uniformly, this technique calculates a shade of 
gray for each point. In effect the method inter- 
polates the shade of the point from those around 
it, across facet boundaries. In actual proced- 
ure, the Gouraud method shades a point by 
linear interpolation between two edge-colors: 
the color of the last edge and the next edge to 
be encountered on the present scan-line. 

(These shades are in turn found by linear inter- 
polation between their endpoints. ) 


It will be noted that Gouraud's method 
does not curve the edges. But considering its 
simplicity as a small addition to the Watkins box, 
that's no great. sacrifice. 


Naturally, the Watkins Box will not reach 
the private home for several years; current 
likely price is in six figures. But that's now. 
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GOURAYD'S SPECIAL TWIST 
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PRA'S WORLD-VIEW 


Roger Boyell, of Pennsylvania Research 
Associates, Philadelphia, likes to refer to the 
company's main interest as "modelling the phys- 
ical world." Thus he and his associates have 
developed systems for cartography, landscape 
modelling, pipe design, and simulation of com- 
plex radar systems. 


A radar simulator they are putting to- 
gether for the Navy will show the results of any 
possible radar system moving over any possible 
terrain. A pilot or navigator trainee, in a sim- 
mulated cockpit, will see the mission's changing 
radar picture as he changes the plane's course 
or the radar's tuning. The radar picture, ap- 
pearing on a screen and changing in real time, 
will look just the way the radar would look on 
a real mission-- flying in perspective among 
mountains or valleys, high or low, at any bear- 
ing and speed, and viewed through any type of 
radar. 


Boyell's approach is to treat each compo- 
nent of the pictorial/radar simulation as a 
separate problem, to be handled in different 
ways, and blended in a final buffer, a core 
memory which is read out to television. Sepa- 
rate mechanisms supply components of shadow, 
specular reflection, coloration and randomizing 
effects. The core buffer continuously refreshes 
the scanned CRT display. 


Boyell has put the same techniques to 
work making simulated halftone pictures of the 
moon (see cut). Both the radar and moon sys- 
tems use the same type of halftone image synthe- 
sis, even though superficially they seem quite 
different. But radar is radiation, just like light, 
and Boyell's techniques of three-dimensional 
modelling and search apply equally well to de- 
piction by reflected visible light-- i.e., half- 
tone images. 


Boyele’s TERRARIUM 


core-memory buffer with a TV image constantly 
being read out (much like the Knowlton-Schwartz 
setup: see pp. DM10 and DM24, top Schwartz 
picture) and changes individual features one- 
at-a-time to match a changing view. 
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An outfit called tiUMRRO, in Washington, Say 
they have a real-time interactive half-tone 
that will knock several people out of the 
ballpark-- especially the GE hardware and 

the Evans and Sutherland Watkins Box (earlier). 


The HUMRRO system is intended to go out 
to color screens (modified Sony Trinitrons) 
with shaded pol ygon halftone, offering 
pseudo-curved shading like Gouraud's (see 
earlier). 


The techniques were worked out by Ron 
Swallow, and they're not teliing about how 
they work. It is claimed, however, that their 
real-time picture generator handles scenes 
with 16,000 edges, and that this will cost 
$150,000 and service 16 (or was it 64) user 


terminals simultaneously. 


It may have been a bad phone connection, 
or this may be what they're really claiming. 
Obviously it'll be really great if it turns 
out. to” be ‘real: 


Evidently they have in mind the use of 
such high-performance scopes for teaching, al- 
lowing students to explore intricate three- 
dimensional scenes or objects. Terrific. 


(Note: compare the claim of 16,000 edges 
on a $150,000 system with the 2000 (7) edges 
allowed by the old NASA system built by GE, 
or the Watkins Box-- I don't know how many 
edges-- at $500,000 from Evans and Sutherland.) 


THE SHAPE OF THINGS TO COME 


If these systems sound far-fetched, or only 
for theoretical investigtation, consider this: the 
Air Force is now letting contracts for an ad- 
vanced flight-training simulator that is a small 
boy's dream. To be situated in Dry Lake, 
Arizona, the simulator will have the most real- 
istic cockpits ever built: the entire mockup will 
turn and tilt in response to the user, and the 
seats will even swell and deflate, to simulate 
acceleration and weightlessness. The cockpits 
alone, without the visual display screens, will 
cost ten million dollars each. 


But the visual systems-- ah. The pilot- 
user will look out into an artificial world, among 
whose mountains and meadows and clouds he 
will fly in real time. Six CRTs, arranged as 
parts of a dodecahedron in an entire visual 
surround, will show him the changing terrain 
and flying environment. Each of these CRTs 
will be driven by a real-time perspective 
halftone simulator, with all displays spliced to- 
gether and driven by a master simulator res- 
ponding to his actions. Who will build them is 
not yet decided; they could be Warnock or GE 
boxes. 


The sheer joy of such a system will be 
hard to beat. But no doubt others will be on 
the way-- perhaps at the amusement-park level. 


The new pilot trainer will not only swing 
and dip in response to the controls; on 
six giant CRTs, with optics in front that 
focus the eye on infinity and connected 

at the seams, the pilot will see a res- 
ponding perspective simulation of the 
world he is flying through, planes he is 
dogfighting with, and who knows-- witches? 
Superman? 
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NELSON's FANTASM: 
A LOT OF BoseH ? 


I don't expect you to believe this, because 
not even my patent attorney does, but the system 
I call Fantasm is intended to make pictures that 
pass the Turing-test: you won't be able to tell 
them from real photographs. Fantasm is inten- 
ded to allow the user to make realistic, Hierony- 
mus Bosch-like photographs and movies, with 
real-looking people (and scenery, imaginary 
characters, monsters, etc.) in scenes of arbi- 
trary complexity. It is expected that 1975 eco- 
nomics will make its construction feasible. 


Fantasm I originally conceived as a method 
of making realistic photographs and movies, not 
knowing at the time that this was impossible, 
but feeling it could be done somehow if the 
problem were broken down sufficiently. At 
times it was not clear which of us would be 
broken down first, I or it. 


It occurred to me sometime in 1960-1 that 
computer-interpolated, Disney-type cartooning 
methods would be feasible. After some thought 
I realized that pseudo-photography would be 
possible, and dropped the cartooning idea. The 
strange behavior of people whom I told about 
this led me to increasing secrecy. 


The general goal was to make a system 
that. could do realistic movies without scenery 
or actors, and make pictures indistinguishable 
from real photographs of real scenery and 
actors. ("What do you mean, indistinguishable 
from photographs?" people keep asking. What 
do they mean what do I mean?) The surfaces 
are to be put in by "sculptors," animated by 
"puppeteers," and photographed by a "director." 
The objective is for moviemaking to be under 
the utter imaginative control of the creative user. 


I am tndebted to Prof. Charles Strauss 
for the formalization of my smoothing- 
funetton, 
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FANTASM, AT UST PARTIALLY REVEALED, 


at least to certain readers, 


A scene of arbitrary curvature and topology is represented 
in a system of holding registers; the surface is presented 
(through D-to-A converters and an array parallel function gener- 
ator) to interrogating circuitry which steers an inquiring signal 
around the represented surfaces. Operation is empirical. Array 
has partition logic allowing simultaneous queries of various sub- 
surfaces. Feedback steering circuitry allows multiple loops 
through array. Steering signal and returned surface parameter 
are analog and continuous. List techniques manage shadow and 
visibility 'umbrellas' (surfaces of occuited volumes or umbras). 


The Fantasm Scene Machin&lD, the representation and search 
array, is one chip repeated in a carpet. Large-scale integration 
permits the required digital storage of about 500 bits per sur- 
face section plus analog circuitry and switching logic. Patent 
work underway. 


SUMMARY: outlines handled by Perimeter Parameter Occultation 
Chasing, fill-in by Bullet Search, animation continuity management 
by list-processing techniques. 
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The system could come in a number of dif- 
ferent versions. One of these involves a large 
array of LSI computing modules (the checkerboard 
Scene Machine) to be guided by special hardware 
under an unusual monitor running on a general- 
purpose computer. The checkerboard Scene 
Machine holds a great spread of surface data. 

It is a logical curiosity, an array that replies as 
a unit, ignoring cell boundaries, to electrical 
explorations of the shapes represented in it. 
The resulting trace makes various 3-space ex- 
plorations on the faces, mountains or automobiles 
spreadeagled in it. Think of its trace as a 
radio-controlled firefly skating over a bumpy 
checkerboard. Using this machine, and various 
cat's-cradle list structures based on the geom- 
etry of light around odd volumes of occultation, 
the problem of halftone analysis of arbitrary 
shapes is solved by brute force rather than 
analytically. A variety of other processes have 
also been defined in the system for other types 
of graphic application. 


As far as I have been able to learn, Fan- 
tasm is the most baroque computer graphic system 
anyone has proposed. It is not intended to oper- 
ate in real time, but rather take as long as it 
needs, or as long as the user wants to pay for, 
to fill in complex visual details, shadow, reflec- 
tions, curlicues, leaves, hair, etc. It is best 
suited to the production in Panavision of Busby 
Berkeley musicals, or "The Lord of the Rings" 
with realistic wraiths and interspecies battles. 
But it may well cost too much to use for that. 
Indeed, its economics seem to improve in low- 
budget settings like videotape, although there 
its output bandwidth will flower unseen. But 
the Scene Machine should also be useful for 
more mundane applications, such as contour 
mapping, automobile design, advertising photo- 
graphy and medical illustration. 
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FOURTH ARTICLE. 


Systems of Computer Image Corporation. 


COMPUTER TMAGE!S Mid WHIRL 


SO FAR WE HAVE SUMMARIZED AND DISTINGUISHED AMONG 


THE MAJOR TECHNIQUES FOR COMPUTER SYNTHESIS OF IMAGES 


FROM DIGITALLY STORED REPRESENTATIONS OF SCENES. 
WE NOW TAKE THE WRAPS FROM A DIFFERENT BUT RELATED 


SET OF TECHNIQUES-- THE SYSTEMS OF 
COMPUTER IMAGE CORPORATION. 


Lee Harrison III got the idea for what is 
now Computer Image Corporation in 1959. Al- 
ready having an art degree, he went on for a 
degree in electrical engineering, and through 
long lean years put together the technical basics 
around which CI's systems are now built. Com- 
puter Image Corporation is now a going concern, 
and output from their systems, especially Scan- 
imate, is now widely visible on television. 


Computer Image Corporation seems to be 
the first firm to be commercially successful in 
the halftone field. Whether they should be 
included with the others is arguable, however. 
Their systems are not widely understood, and 
the relation of these systems to the other systems 
and programs described in these articles is 
problematical. Among the few who understand 
their techniques, some argue that they do not 
synthesize images at all, but rather twist pre- 
existing pictures with a sort of Moog synthesizer, 
and that their analog techniques are really just 
compound oscillators rather than true computing. 
I think that this view is wrong, at least as 
regards their most ambitious system, and that 
CI's techniques deserve review. All the world 
is not digital. CI systems do fill up areas with 
grey-scale (and other) pictures, and their sys- 
tems involve three-dimensional coordinates, 
occultation and coloration; thus I think it ap- 
propriate to discuss them here. 


The following discussion is the first, I 
believe, to lift the veil of secrecy that has hith- 
erto confounded observers of this company's 
work. In the light of the extreme sophistication 
with which they have pursued extremely strange 
techniques, they should benefit from the wider 
understanding. (Note that this material, which 
has been assembled from various sources and 
careful TV watching, is partly conjectural.) 


Computer Image's systems represent an 
apparently unpromising approach brilliantly 
followed through. 


All of CI's systems are a strange combin- 
ation of closed-circuit TV and analog components 
out of a music synthesizer: oscillators, poten- 
tiometers, interconnection networks. The basic 
mechanisms are the same for all, but they are 
carried to different logical extremes, with dif- 
fering accoutrements, in the four systems. 

They all seem to be based on the extraordinary 
Animac II, not yet implemented; it would seem 
that for business reasons the company decided 
to raise money promoting simpler systems, so 
its bread and butter now consists of two less 
ambitious systems, Scanimate and Animac I; 
both of which might be puzzling if not recog- 
nized as parts of a more elegant whole. It 
would seem they were designed backwards as 
spinoffs from Animac II, as was CAESAR, their 
more recent 2-D system. 


The extraordinary ramifications and 
varieties of this system, with all its electronic 
add-on and composite methods, stagger the most 
jaded technical imagination. 


At the heart of the CI systems is the prin- 
ciple of filling areas of a CRT screen with an 
oscillating trace. This is a principle common 
to both Lissajous figures and television; but 
Computer Image has elaborated it peculiarly. 

By variations they paint twisted television images, 
wiggle sections of superimposed drawings, create 
moving filigree effects, and hope to animate 

whole groups of opaque electronic puppets in 
3-space. 


Consider an oscillating trace on an oscillo- 
scope. This is a two-dimensional oscillation, 
having two signals, x and y. But a three-dim- 
ensional oscillation is also possible; any third 
signal, z, can be interpreted as a third dimen- 
sion, meaning that a "point of light" is whirling 
out some pattern in a three-dimensional space-- 
an oscillotank, so to speak. Let us call this 
point moving in three dimensions a "space trace." 


Now to view this trace we need to cut it 
down to two dimensions. By ignoring one of 
the traces we can view the oscillotank in certain 
fixed ways; but by creating a "view calculator," 
a box performing certain perspective transfor- 
mations on the three signals of the space trace, 
we may obtain a view of the oscillotank from a 
movable vantage point. This is an x-y view 
which we may put on an ordinary oscilloscope. 


Let us now add one more signal, b (for 
brightness). This is the brightness signal fam- 
iliar in television: 


Brightness of the spot is thus independent 
of the movement of the space trace. For example, 
the space trace could describe a helical path, a 
sort of tornado motion, and we could time its 
spinning to phase with a TV signal. If we now 
brighten the space trace only with the bright- 
ness signal of a TV pickup, we now will see 
(in our view of the oscillotank) what would look 
like a TV picture curled around itself in space. 


The different CI systems are built around 
this effect. 


Output from all these signals is ordinarily 
picked up by another vidicon, which stabilizes 
it by converting it into conventional television 


imagery. 


THE WHIZUNG UNIVERSE OF CeMPUTER IMAGE COLPOLATCN, 


As oscifoscspe Trace 


CAESAR System. Characters are 
made to move jaws and lips by 


Scanimate's twirl, by now familiar jointing technique similar to 
to most TV watchers. Scanimate is Animac II (below), but in such 
extensively used on "The Electric a way as to matte over drawn 
Company? artwork-- meantime wiggling 


other drawn artwork through 
scan manipulation. 


wf 3 Third dmasron added Teche sally 


movable 


OM fla Inj Ctess & 
fl 5 »D sseeffrace 
Co\trol}e4 L 


(ee 
boos Jf f YV CeteVS | 


gives us a window into a peculiar sort of world: 
a world in which luminous shapes can undulate and 
spin on invisible spindles (Scanimate), or wiggle 
as separate bones (CAESAR. 


Tubelike shapes may be rotated and shaped in = 
3D (Animac), and puppets may eventually be rolled 
like cigarettes (Animac II), which may then be 
painted from a TV pickup on the side nearest the 
viewpoint. 


By using a storage tube and spinning the trace 
close together, like cotton candy, and cutting of £ 
the painting signal while the trace is within the Ly 


area already filled, we get electronic masking: - 7S 

which blends animated drawings in 2D (CAESAR) a A 

and may eventually manage shadows and occultation pee oem = 7 
pal’. 


nasking among 3D puppets (Animac II). 


SHAPING METHO! 


Lissajo_us and zigzag figures 
are rapidly spun in three dimensions 


-- that is, varying voltages x, y 
and z. The resulting "tubes" and od | 
"curtains" are then viewed by per- ern is 


spective calculation. The circuitry 


permits 
joints, 


changes. 


IN 


IN 


IN 


these shapes to flex at 
wave, and go through other 


SCANIMATE: zigzag and 
curling shapes define a 
moving scroll on which an 
image is painted. 


spin out same 
pact on storage 
scope; contin- 
uously test 
potential of 
screen; 


CAESAR: curling Shapes are 
treated 2-dimensionally, 
as blocking controls for -- AND LATER, IN THE SAME FRAME: 
artwork, 

cut off the 

ANIMAC IL: puppets will be brightness of 

sculpted much like rolling the output signal, 


a cigarette, wherever there is 


already an image 
on the screen. 
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The only picture I've been able to 
find that relates to the 3D sculpturing of 
Animac II is this frame, blown up from a 
short l6mm sequence. The figure is sculp- 
tured from oscillations in three variables, 
modulated to represent this figure of thir- 
teen sections or "bones." Head and torso 
are clearly visible in the film; the figure 
is seen to spin as if in an ejection seat. 
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A last CI technique, technically minor but 
remarkable in effect, permits this blocking and 
shadowing among separate objects. This is the 
use of a storage CRT tube on which every frame 
is painted (from the viewpoint or from the light 
source). The picture is painted on the storage 
CRT, nearest things first; and the return signal 
from the screen tells whether the space trace is 
crossing an area already painted during the 
frame. The tube's output signal then effectively 
constitutes a silhouette. This clue indicates that 
the space trace should not be visible; and hence 
is used to cut off brightness while the trace is 
within the already-filled area. This gates 
between two desired objects or pictures, fore- 
ground and background. If operated from the 
point of view of the light, it gates shadow: the 
signal is used to control the relative brightness 
of the shadowed and unshadowed features of a 
puppet in 3-space. 


A fascinating variety of embellishments 
has been put into these systems by CI's ingen- 
ious engineers. Coloration of the final video 
Signal is added by. gating color levels under 
control of the brightness signal, permitting pic- 
tures with several grey-levels to be transformed 
to up to four rainbow hues. Separate shapes 
described by the space trace may be indepen- 
dently moved and jointed at the same time: 
Harrison pointedly calls such separate shapes 
"bones." Darkening at the backside of a spun 
shape, or brightening at edges of a painted por- 
tion, and brightening in proportion to curl, are 
all strange capabilities of this machine. Lip- 
synchronized mouthlike motion can be imparted 
to any part of the shape spun by the space trace 
(whether or not a mouth is painted on it), by an 
audio detector feeding directly to the circuitry 
from a live mike. And the limbs of CI's ghostly 
figures can be made to swing by connection of 
sensors to the animators themselves-- in a living 
pantograph. 

SCANIMATE is a popular device now widely 
used (at CI's studios) for the making of TV com- 
mercials and station-break emblems. This is 
their simplest system, used for the conversion 
and discombobulation of flat artwork. In Scani- 
mate, the space trace is controlled by hand- 
operated potentiometers. Two separate oscillator 
settings are available, so that the space trace 
can have two separate oscillation patterns, 
spinning out two entirely different virtual shapes 
in 3-space. A hand-throttle eases from one 
oscillator setting to the other. This permits an 
image to be moved, shrunk or enlarged, or 
flipped; to go from whirling around to a sort of 
hula; and many more effects. The picture 
painted on it may be seen to roll on invisible 
spindles, bloom into fountains, or undulate as 
pennants-~- all by modulating the brightness of 
the flying spot as it traces its unseen shape. 
This shape, in turn, can move between its two 
forms under control of the throttle. 


Animac I (usually called Animac) provides 
greater flexibility in controlling the space trace. 
The system's oscillations are controlled by an 
input vidicon, which artists may quickly modify 
with pastel check at the pickup. Ghostly tubu- 
lar lettering, swarming pendulum-patterns and 
jiggling filigrees are among the possible doodles. 


CAESAR, their newest system, is oriented 
toward Yogi Bear-type animation. The artist's 
cartoons are automatically superimposed on a 
background or each other. They may be moved, 
and made to wiggle under real-time control by 
the user. 


But it is to Animac II that these curiosities 
lead. What Harrison calls the "Snow White 
Capability" of Animac II will permit the sculpture 
of full humanoid puppets, with perhaps thirty 
articulated "bones," opaque to one another and 
casting shadows, colored, moving and talking. 


Two young fellas in a Manhattan Loft, 
Messrs. Rutt and Etra, are offering a 
machine similar to Scanimate but much 
cheaper. 
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It's not as finely detailed-- the inner 
screen runs at 525 lines rather than 
700-- but it costs some $15,000 instead 
of $150,000. 
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WHAT ABOUT REAL THREE-DIMENSIONAL 


9 
DISPLAY? Lou Katz, of NYU, put old-fashioned stereop- 


ticons up to the CRT, and displayed two separate 
views to the two eyes. Works fine, even with 
isometric display. 


In science-fiction stories you hear about 
how objects are made to appear as if they're 
standing in the middle of the room. For instance, 


I believe that in Heinlein's Stranger in a Strange 


Land they watched a "tank" in which things 


appeared. 


Well, a lot of people have thought about 


this, and it's not so easy as you might think. 


One interesting scheme used a sort of 


translucent propellor, spinning rather fast, on 
which computer-generated images were pro- 
jected from below. It was done by the dotting 
method, so that a bright dot of light would ap- 
pear high or low in space depending on whe- 
ther it was projected on a relatively high or low 
point on the propellor. 
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This was interesting but had numerous 
disadvantages-- not the least of which was the 
danger of the thing flying apart. (Translucent 
materials tend not to be as strong as, say, 
metal.) Another basic problem, though, was 
the fact that any given point in the space could 
only be displayed at a given time, when the 
propellor's height in that region was just right, 
and that meant that at that given instant you 
couldn't display any of the other points that 
could only be displayed at that instant. A con- 
siderable disadvantage. 


Probably the most astonishing 3D display 
is Sutherland's Incredible Helmet. This consists 
of a helmet with two dinky CRTs mounted on it, 
each being driven in real time by a perspective 
system (such as the LDS-1) and set up with 
prisms to the wearer's eyes. Through the prisms 
the wearer can see the real world in front of him. 
Reflected in the prisms, however, and thus mixed 
into the view of the real world, is the glowing 
wire-frame being presented to him-- in perspec- 


not stand still: as he moves, the helmet's chan- 
ging position is monitored by the program, and 
the display system changes the views accordingly 
meaning he can walk around and through a dis- 
played object. The illusion, and the possibilities, 
are fantastic: imaginary architecture, explanations 
and diagrams of things in the room, poetry that 
changes as you walk through it, . well, you 
work on it. Not available commercially. 
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GOING LIKE A BASTARD 


RETURN OTHE FOLD 


There was a lot to be said for tents. They 
could be made by tailors, rather than construc- 
tion gangs; they could be transported and stored 
flat. Their surface-to-volume ratios couldn't be 
beat. 


Noting this, an architect named Ron Resch 
said to himself: what about making large-scale 
foldable structures, likeunto geodesic domes, 
that cou_ld be simply manufactured in sheet 
form and creased at the factory, then bolted and 
cabled and strutted in the field? 


Resch has now for years been experi- 
menting with complex folded structures. 


There's only one trouble. If you've 
messed with paper airplanes you know that 
folding is an inaccurate process, and so the 
prospect of discovering complex geometric struc- 
tures by the hand-folding of paper is rather 
slim. 


Recognizing this, Resch has contrived to 
work at a computer display. His work-- the 
search for great folding structures-- is one of 
the first practical uses of halftone polygon 
computer graphics. He is, naturally, at the 
University of Utah. 


Bob Spinrad of Xerox Data Systems has a 
patent on displaying 3D from a eomputer through 
an ordinary color TV. Assuming you're using 
some standard way of refreshing the TV-- des- 
cribed elsewhere-- the image for one eye is dis- 
played in green, the other in red, and you look 
through red and gzveen glasses. The wonders of 
modern science. Spinrad chuckles over it him- 
self. 


Another scheme glued silver Mylar to the 
front of a loudspeaker, then played a soft hum 
through the loudspeaker to pulse the Mylar back 
and forth. Then you used that as a mirror to 
look at what was going on the CRT-- which was 
showing a lot of points at odd places that would 
appear to be in space. Unfortunately this was 
hard to coordinate, and, like the propellor, 
often required you to put dots in several places 
at once, which don't work. 


For a while you could get-- maybe you 
still can-- a three-dimensional computer output 
device. Here's what it did: it created objects 
showing data structures that had three variables. 
(it didn't make wire-frame objects or the like.) 
Automatically ejecting wire through a styrofoam 
block, and snipping the done ones, it created 
little mountains showing three-dimensional data. 
Very cute. Since many people have problems 
with mountainous computer data, it probably 
should have caught on. 


Then a lot of people mumble the word 
"holography," as if that is going to settle some- 
thing. While holograms are terrific and remark- 
able, and have been produced on computers, 
making them is not a process that can be carried 
out decently on sequential machines-- let alone 
making them in real time. So if a solution to 
interactive three-dimensional computer display 
is going to come through holography, it means 
a whole new batch of technology will have to be 
invented. 


‘My friend Andrew J. Singer, who comes 
and goes in the computer field and is one of 
the five or six smartest people I ever met, says 
he knows how to build a display tank, and I 
believe him. He explained it quickly to me once 
and I asked him to tell it again, but he just said 
sadly, "What's the use-- there are so many 
great things that could be done..." 


FOUR DIMENSIONS, EGAD 


So’ much for three dimensions. Now, some 
readers are bound to ask, "What about four dim- 
ensions?" because they are science-fiction fans 
or troublemakers or mathematicians or something. 


Just aS we can make a two-dimensional 
picture of a three-dimensional object, it is pos- 
sible, dear reader, to make a two-dimensional 
picture of a four-dimensional object. 


What is a four-dimensional object? 


Why, any object that has four dimensions, 
(thanks a lot, you say), or even four measurable 
qualities, such as height, weight, age and grade 
point average. Well, let's not get into that, but 
it turns out that views of such multidimensional 
structures may be obtained by the same homogen- 
eous matrix techniques already mentioned for 
regular perspective calculations. Rule of thumb: 
however many dimensions your data has originally, 
you add one more dimension, homogeneous with 
the rest, and there exist formulas (sorry, I don't 
have them) for view calculation. 


(Note, of course, that while a two-dimen- 
sional view is a picture, a three-dimensional 
view is a three-dimensional object-- you'll have 
to view it on an interactive 3D computer display 
of some kind.) 


Ed of RTHE MINDS EVER 


HECRCLE GRAPHICS HABIFAT rs 


SANDIN Js 
IMEGE PROCESSOR 


damerg . 


(wf 1% phofe ) 


From vtdeotape, 


"The Hydrogen Atom 
Aecording to oe Ma 
Quantum Mechanics" re Se Reen ——————4“ 
by T.Jd. O'Donnell Sh 35 (Vector Geners| 3DR) 
& Davtd Parrish. npof dial! eth wew cslerl ator 
(rre on Sig liakt-pen 
va arbitravily)| 
video 
terminal mpl tablet 
tos) & stylus 
It is usualiy hard to combine things: keyboard 
especially complicated technical things. thoy ent — a. 
Usually it takes infinite reconsiderations, aa 
finagling, modification, intertwingling. push buttons 


(pre Yaw Cah 


The Circle Graphics Habitat, however, v3 arbitrarily) 


is something else again. It results from 
two intricate, independent technological 
developments, each an intricate system care- 
fully crafted by an exceptionally talented 
person, coming together like two hands clap- 
ing. Like ham and eggs, like man and woman, 
Sandin's Image Processor and DeFanti's GRASS 
language conjoin directly and interact per- 
fectly as if they had been made for each 
other, which they were not. 
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Dan Sandin's Image Processor (see p. JM2) 
1s a system of circuit boxes that allow 
video images to be dynamically colored, mat- 
ted, dissolved and palpitated; Tom DeFanti's 
language (see ''Coup de GRASS, p. bm'31) per- 
mits the rapid creation, viewing and manip- 
ulation of three-dimensional objects on the 
screen of a particular computer setup. 


To combine them, you just point Dan's 
System at Tom's system. 


From videotape, 
"The Number Cruncher," 


! ! 
Let's say that on the screen of Tom's by TDF & DJs. 


System we are viewing an animated bird, 
flapping its wings. Since it's being shown 
on a three-dimensional refreshed line display 
(see pp.dm22-3, 530), it appears only as white 
lines on a dark screen. 


Dan merely points a TV camera at Tom's 
screen, and runs the TV signal into his Inm- 
age Processor. Now, in the Image Processor, 
he gives it the magic of color. Different 
colors, interplaying with gradations and 
subtlety. 


From vtdeotape, 
"The Sptral Tape," 
by DJS and TDF. 


From the Image Processor, the finished 
Signal goes out to videotape recorders. 


What then have we overall? One of the 
world's most flexible facilities for the 
rapid production of educational videotapes. 


To explain something, you create a 
three-dimensional stick-figure "model" of it, 
using DeFanti's GRASS language. Then you 
make a videotape of it, showing rotations or 
other manipulations, using the Image Proces- 
sor to give it color. 


PDP | Video Monitor 
DeFanti and Sandin have spent much of Computer Video Kecorder 


the academic year '73-4 getting the kinks out 
of this procedure. (Many of the difficulties 
stem from the unreliability of videotape re- TV caners 
corders.) Stills from some of the first work 


are shown here. 
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The TISSOE OF THOUGHT 


Uneducated people typically think of 
education as the learning of a lot of facts 
and skills. While facts and skills certainly 
have their merits, "higher education" is also 
largely concerned with tying ideas together, 
and especially alternative structures of such 
tying-together: with showing you the vast un- 
certainties of things. 


A wonderful Japanese film of the fifties 
was called Rasho-Mon. It depicted a specific 
event-- a rape-- as told by five different 
people. As the audience watches the five se- 
parate stories, they must try to judge what 


really happened. 


The Rasho-Mon Principle: everything is 
like that. The complete truth about something 
is never known. 


Nobody tells the complete truth, though 
some try. Nobody knows the complete truth. 
Nowhere may we find printed the complete truth. 
There are only different views, assertions, 
supposed facts that support one view or another 
but are disputed by disbelievers in the particu- 
lar views; and so on. There are "agreed-on 
facts," but their meaning is often in doubt. 


The great compromise of the western world 
is that we go by the rule: assume that we never 
know the final truth about anything. There are 
continuing Issues, Mysteries, Continuing Dia- 
logues. What about flying saucers, "why Rome 
fell," was there a Passover Plot, and Did Roose- 
velt know Pearl Harbor would be attacked? 


Outsiders find the intellectual world pom- 
pous, vague in its undecided issues, stuffy in 
its quotes and citations. But in a way these 
are the sounds of battle. The clash of theories 
is what many find exhilarating about the intel- 
lectual world. The Scholarly Arena is simply 
a Circus Maximus in which these battles are sche- 
duled. 


Many people think "science" is free from 
all this. These are people who do not know much 
about science. More and more is scientifically 
known, true; but it is repeatedly discovered that 
some scientific "knowledge" is untrue, and this 
problem is built into the system. The important 
thing about science is not that everything will 
be known, or that everything unanimously believ- 
ed by scientists is necessarily true, but that 
science contains a system for seeking untruth 
and purging it. 


This is the great tradition of western 
Civilization. The Western World is, in an 
important sense, a continuing dialogue among 
people who have thought different things. 
"Scholarship" is the tradition of trying to 
improve, collate and resolve uncertainties. 

The fundamental ground rules are that no issue 

is ever closed, no interconnection is impossible. 
It all comes down to what is written, because 

the thoughts and minds themselves, oF course, do 
not last. (The apparatus of citation and foot- 
note are simply a combination of hat-tipping, 
go-look-if-you-don't-believe-me, and you-might- 
want-to-read-this-yourself.) 


"Knowledge," then-- and indeed most of our 
Civilization and what remains of those previous-- 
is a vasty cross-tangle of ideas and evidential 
materials, not a pyramid of truth. So that pre- 
serving its structure, and improving its accessi- 
bility, is important to us all. 


Which is one reason we need hypertexts and 
thinkertoys. 
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HOW Yo LEARN ANYTHING 


As far as I can tell, these are the techniques used 
by bright people who want to learn something other than 
by taking courses in it. It's the way Ph.D.'s pick up 
a second field; it's the way journalists and "geniuses" 
Operate; it brings the general understandings of a field 
that children of eminent people in that field get asa 
birthright; it's the way anybody can learn anything, if 
he has the nerve. 


- DECIDE WHAT YOU WANT TO LEARN. But you can't 
know exactly, because of course you don't know exactly 
how any field is structured until you know all about it. 


ON (T, 
2. READ EVERYTHING YOU CANa especially what you 
enjoy, since that way you can read more of it and faster. 


as GRAB FOR INSIGHTS. Regardless of points others 
are trying to make, when you recognize an insight that has 
meaning for you, make it your own. It may have to do with 
the shape of molecules, or the personality of a specific 
emperor, or the quirks of a Great Man in the Field. Its 
importance is not how central it is, but how clear and in- 
teresting and memorable to you. REMEMBER IT. Then go for 
another. 


4. TIE INSIGHTS TOGETHER. Soon you will have your 
own string of insights in a field, like the string of lights 
around a Christmas tree. 


55 CONCENTRATE ON MAGAZINES, NOT BOOKS. Magazines 
have far more insights per inch of text, and can be read 
‘uch faster. But when a book really speaks to you, lavish 
attention onjt. 


6. FIND YOUR OWN SPECIAL TOPICS, AND PURSUE THEM. 


7. GO TO CONVENTIONS. For some reason, conventions are 
a splendid concentrated way to learn things; talking to people 
helps. Don't think you have to be anybody special to go to a 
convention; just plunk down your money. But you have to have 
a handle. Calling yourself a Consultant is good; "Student" is 
perfectly honorable. 


8. "FIND YOUR MAN." Somewhere in the world is someone 
who will answer your questions extraordinarily well. If you 
find him, dog him. He may be a janitor or a teenage kid; no 
matter. Follow him with your begging-bowl, if that's what he 
wants, or take him to expensive restaurants, or whatever. 


Os KEEP IMPROVING YOUR QUESTIONS. Probably in your 
head there are questions that don't seem to line up with 
what you're hearing. Don't assume that-you don't understand; 
keep adjusting the questions till you can get an answer that 
relates to what you wanted. 


10. YOUR FIELD IS BOUNDED WHERE YOU WANT IT TO BE. 
Just because others group and stereotype things in convention- 
al ways does not mean they are necessarily right. Intellectual 
subjects are connected every whichway; your field is what you 
think it is. (Again, this is one of the.things that will give 
you insights and keep you motivated; but it will get you into 
trouble if you try to go for degrees.) 
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There are limitations. This doesn't give you lab ex- 
perience, and you will continually have to be making up for 
gaps. But for alertness and the ability to use his mind, 
give me the man who's learned this way, rather than been 
blinkered and clichéd to death within the educational system. 
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COMPARTNENTALIZED AND STRATIFIED TEACHING MINDS. 


Pronuecs ComPART 


MENTALIZED AND STRATIFIED 


Verbal communication-- whether written or spoken-- 
disassembly of the Tinkertoy of thought 
into pieces, and placing it on a 


"ON WRITING, i) 
a. pavadicw &f the creahie process 


being an examination of some very Complex Matters 
which Nobody Seems to Understand; and whose 

Generality of Relevance may be Gradually Apprehended. 
(Eventually I hope to develop a somewhat more formal 
treatment of "ideas," as distinct from propositions, 
sentence kernels, etc. But there is certainly no room 
for that here. (Logicians: show me the truth-table of 
"BUT ae ) 


The process of writing is poorly understood in most quarters. 
Many working writers despair of being "systematic," getting 
things done as best they can. On the other hand, people who think 
they might be able to contribute-~- particularly the symbolic logi- 
cians and transformational linguists-- being immersed in their own 
formalisms, simply don't see what's going on-- at least, when I've 
tried to talk to them. 


Writing is not simple. As with vision or speech or riding a 
bicycle, an immensely complex process is being unconsciously pur- 
sued. 


Some people think you make an outline and follow it, filling 
out the details of the outline until the piece is finished. This 
is absurd. (True, some people can do this, but that is simply a 
shortcutting of the real process.) Basically writing is ; 


THE TRY-AND-TRY-AGAIN INTERPLAY of PARTS AND DETAILS against 
OVERALL AND UNIFYING IDEAS WHICH KEEP CHANGING. 


In fact a number of things are happening, often simultaneously. 
We can separate them into three: 


1. Provisional development of ideas and points: 
A) forming overall organizing ideas, B) selecting ten- 
tative points; C) inductively finding overall organiza- 
tion among them; D) finding relations of interest between 
points. 

2. Complex sifting and adjustment among collections of points, 
overall ideas. 


3. Fine splicing within developed sequences. 
A) transition and juxtaposition managements, B) cross- 
citations, C) smoothing. ci 


Regrettably, there's no room or time to pursue this here. 
(The article I had intended to write would take a whole spread.) 
For people who really care about the matter, I will make some 
points in very abbreviated form. 


The interesting structures in written material include: 


"Points"-- pieces, sentences, phrases, examples, plot events, 
and expository "points." 


Organizing principles and structures (which we will call here 
arches)-- final ironies, things to be led up to, themes, 
plots, concepts, principles, expository structures, :or- 
ganizing titles, overconcepts. These may be either local 
or global, over the entire work. (Note: arches may not 
be heirarchical relative to one another.) 


Now, we may think of points and arches as individual objects 
which have individual relations to one another. Between two points 
there may be a good transition; a specific point may link well toa 
specific arch. 


The problem in writing, then, is that overall structures you 
choose (systems of arches) may not link well to the points that 
have to be included among them; and that transitions between points 
don't work out the way you want them to. Good transitions can't be 
worked out for the sequence of points you want to make, or, alter- 
natively, there are too many good transitions within a specific 
structure of points, and picking among them involves difficult 
choices-- especially when you have to devise appropriate arches on 
the -basis of the final sequence of points. 


There are a number of other important structures in written 


material. They include accordances, juxtapositions, cross-citations, 


connotations, nuances and rhythms. 
The only ones we will discuss here are accordances. 


The term “accordance," as I shall use it here, is simply a 
vaguely formal way of talking about whether things match or £2 
together. Two items are in accord if they match or fit well, or in 
discord if they match or fit badly. Thus a good transition between 
points (as mentioned early) represents an accord, and a good link 
between a point and an arch is also an accord. 
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Now, it happens that a great deal of writing is concerned with 
notes to the reader about accordances in the material. In fact, 
quite a few words are exclusively concerned with subtly pointing out 
to the reader the accords and discords within the expository structure 
of what he is reading. We may call these accordance-connectives or 
accordance-notes. 


Two of the most basic terms are indeed and but. 
The word indeed has an interesting function. 


The word indeed (in its main use, at the beginning of a sentence) 
indicates an accord between what has just been said and what is to 
follow. In other words, it functions as a pesitive transition, impe- 
tus or gas pedal, indicating a continuation of the flow in the direction 
already indicated. So do the words thus, then, therefore, moreover, so 
and furthermore. These are infix accords, that is, notes of accord 
that go between two items. We also see prefix accords, such as 

since, inasmuch as, insofar as; these have to be followed by 


two clauses, the second of which is in accord with the first. 


The word but is exactly the opposite. It indicates a discord or 
contradistinction, a negative transition, "brakes" in the flow. Other 
such infix discords include nevertheless, despite this, on the other 
hand, even so, and "Actually,..." Similarly, there are prefix dis- 


cords: while, despite, though..., notwithstanding. 


I find this topic of inquiry very interesting. These sorts of 
terms have been used since time immemorial by writers adjusting their 
transitions for smooth flow (note such antiquey variants as haply, 
howbeit, withal, forasmuch and howsomever), but the importance and 
structure of this service has not, I think, been generally understood. 


(Note also that there are more intricate accordance-connectives: 
I wish we could go here into the structure of Im faef..., at least, 
-.-if not... , ... otherwise... , Anyway... , and Now....) 
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(Note: the try-and-try-again revision and reconsideration process, 
tinkering with structural interconnections, is a universal component 
of the creative process in everything from movie editing to machine 
design. There ought to be a name for it. I can't think of a satisfac- 
tory one, although I would commend to your attention grandesigning, 
piece-whole diddlework, grand fuddling, meta-mogrification, and 
that most exalted possibility, tagnebulopsis (the visualization of 
structure in clouds) .) 


The HERITAGE 


The past is like the receding view out the back 
of an automobile: the most recent is more conspicuous, 
and everything seemg eventually to be lost. 


We know we chould save things, but what? Those 
with the job of saving things~- the libraries and mu- 
seums-- save so many of the wrong things, the fashionable 
and expensive and high-toned things esteemed by a -given 
time, and most of the rest slips past. Each generation 
seems to ridicule the things held in esteem by times be- 
fore, but of course this can never be a guide to what 
should be saved. And there is so much to save: music, 
writing, sinking Venice, vanishing species. 


But why should things be saved? Everything is 
deeply intertwingled. We save for knowledge and nos- 
talgia, but what we thought was knowledge often turns 
to nostalgia, and nostalgia often brings us deeper in- 
sights that cut across our lives and very selves.* 


Computers offer an interesting daydream: that we 
may be able to store things digitally instead of 
physically. In other words, turn the libraries to digi- 
tal storage (see Hypertexts, PyRt); digitize paintings 
and photographs (see "Picture Processing, p.9M/o ); even 
digitize the genetic codes of animals, so that species 
can be restored at future dates (see "The Mitiest Com- 
puter," p. 60). . 


Digital storage possesses several special advantages. 
Digitally stored materials may be copied by automatic 
Means; corrective measures are possible, to prevent errors 
from creeping in-- i.e., “no deterioration" in principle; 
and they could be kept in various places, lessening man- 
kind's dependence on its eggs being all in one basket (like 
the Library at Alexandria, whose burning during the occupa- 
tion of Julius Caesar was one of the greatest losses in 
human history). 


But this would of course require far more compact 
and reliable forms of digital storage than exist right now. 


Nevertheless, we better start thinking about it. 
Those who fear a coming holocaust (see p. (/%) had best think 
about pulling some part of mankind through, with some part of 
what he used to have. 


* See T.H. Nelson, The Snunking of the Heart: On the 


1980, unless a decent writing system comes along. 
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BRAN CHIN G- 
PRESENTATIONAL SYSTEMS —— 


HYPERMEDIA 


In recent years a very basic change has occurred in 
We may summarize it 
under the name branching, slthough there are many variants. 
Essentially, today's systems for presenting pictures, texts 
and whatnot can bring you different things automatically 
Selection of this type is gener- 
(I have suggested the generic term 


hypermedia for presentational media which perform in this 
(and other) multidimensional ways, 


A number of branching media exist or are possible. 


presentational systems of all kinds. 


depending on what you do. 


ally called branching. 


Branching movies or hyperfilms (see nearby). 


Branching texts or hypertexts (see nearby). 


Branching audio, music, etc. 


Branching slide-shows. 


Wish we could get into some of that stuff here. 


BRANCHING Movies 


The idea of branching movies is quite exciting. 
The possibility of it is another thing entirely. 


The only system I know of that worked was at the 
1967 Montreal World's Fair (Expo 67). At the Czech 
Pavilion-- you will recall that before the crackdown 
they had quite a yeasty culture going in Czechoslovakia-- 
there were some terrific fantic systems going. One was 
a wall of cubes with slide projectors inside (that roll- 
ed toward you and back as they changed their pictures). 
And then the Movie. 


The Czechoslovakian Branching Movie-- I forget its 
real name-- had the audience vote on what was to happen 
next at a number of different junctures. What should 
she do now, what will he do next, etc. And lo and behold! 
after they had voted, the lights went down, and that's 
what would happen next. People agreed that this gave 
the movie a special immediacy. 


I never saw the movie-- I waited in line several 
hours but the line was too long to get into the last show- 
ing. So instead I went backstage and talked to Radusz Cin- 
cera, who worked out the system. It turns out that it 
didn't work quite the way people supposed. A lot of people 
thought that "all the possibilities" had been filmed in ad- 
vance. Actually, there were always only two possibilities, 


and no matter what the audience had chosen, somehow the film 


was plotted to come down to the same next choice anyway: 


In the actual setup, they simply had two projectors 
running side by side, with Film A and Film B, and the 
projectionist would drop an opaque slide in front of 
whichever wasn't chosen. But Cincera said that aud- 
iences almost always chose the same alternatives anyway, 
so half the movie was hardly ever used... 


In the early sixties a movie was making the rounds 
in which audiences were supposedly allowed to vote on the 
ending-- "Mr. Sardonicus," I believe it was called. From 
the ads it seemed that audiences would be polled as to 
which last reel to show. Whether the villain was to get 
his comeuppance, or whatever. 


Then there was that Panacolor cartridge projector, 
mentioned elsewhere, which would have allowed choices by 
the user 


More recently there's the CMX system, also mentioned 
elsewhere. This is a setup, being jointly marketed by 
CBS and Memorex, for computer-controlled movie editing. 
But actually it could also be used as a branching movie sy- 
stem. Essentially the movie itself is stored frame-by- 
frame (as video) on big disks, made by Memorex; and, under 
computer control, the output can be switched rapidly among 
the frames, effectively showing the stored movies. (To my 
knowledge, the video networks haven't yet recognized the 
possibilities of this.) 


The only trouble is, it's extremely expensive (half a 
million?), it has an exact storage capacity limited by the 


_ number of disk tracks (presumably one track per frame) -- 


perhaps five minutes total one one big unit, but you can 
buy more-- and it can only give its full performance to 
one viewer at a time.) (Or To the whole nébvorle |rve-) 


It may be that the most practical branching movie 
system would be a cartridge movie viewer and a big stack of 
cartridges. When you make your choice, change the cart- 
ridge. But of course that's not as much fun as having it 
happen automatically. 


REALITY IS OBSOLETE 


The idea that objective reality is perceived by our senses, 
is an obsolete concept. Old truisms like "seeing is believing", 
become much less believable as we become more aware that, the 
biological machinery of life itself, transforms images of the 
physical world before we are made conscious of them. These 
biological mechanisms share many similarities in principle and 
in application, to other mechanisms observed in the natural 
environment and those invented for our own use. Since we are 
becoming more aware of the nature of perception and those 
mechanisms involved, now is the time to gain control-of our- 
selves and share more discretion in the Operation‘ of our own 
biological machinery. We have entered the age of hyper-reality. 


Day-to-day living provides only a limited variety of 
physical stimulus, and little incentive to manipulate the 
physiological and psychological processing involved. Man's 
historical preoccupation with the need to maintain constant 
images of the physical world, is a product of his extreme 
orientation toward physical survival in a hostile environment. 
The current evolving society of leisure orientations removes 
this need for constant images and thereby enhances the opportunities 
for .a more complete use of the sensory apparatus and those re- 
lated brain functions. Many have turned to drugs or meditation. 
More specifically it is proposed here, that modern communications 
technology be employed as a "vehicle of departure" from this need 
for constant images, to bring about a more complete use of the 
human technology itself. Hyper-reality is the employment of 
technology other than the biological machinery, when used to 


affect the performance of the biological machinery beyond its 
own limitations. This is almost like making adjustments on a 
television set, except you are what's plugged in, and the con- 
trols are outside your body, being part of whatever technology 
is interfaced to the body itself. As part of such a man- 
machine interface you could extend your own mental processes, 

or if you should choose, you could just diddle with the dials. 
Hyper-reality is an opportunity to enhance the various qualities 
of the human experience. Reality is obsolete. 


~~ How Wachspress (see p. DM 6) 
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GREENE TUG- 


Now, in our time, we are turning Gutenberg 
around. The technology of movable type created 
certain structures and practices around the writ- 
ten word. Now the technology of computer screen 
displays make possible almost an Structures and. 


practices you can imagine for the written word. 


So now what? 


For new forms of written communication am- 
ong people who know each other, jump to "Engel- 
bart" piece, nearby. 


To learn about new forms of multidimensional 
documents for computer Screens, jump to "Hyper- 
texts." 


Or just feel free to browse. 


HYPERTEXT 


By "hypertext" I mean non-sequential 


ary (The astute reader, and anybody who's gotten 
writing. 


to this point must be, will have noticed that 
this book is in magazine" layout, organized 
visually by ideas and meanings, for that pre- 
cise reason. I will be interested to hear 
whether that has worked.) 


Ordinary writing is sequential for two 
reasons. First, it grew out of speech and 
speech-making, which have to be sequential; 
and second, because books are not convenient 


Ce ret 38 a seNeneS. And the pity of it is that (like the man 


But the structures of ideas are not se- 
quential. They tie together every whichway. 
And when we write, we are always trying to 
tie things together in non-sequential ways 
(see p.8M 42). The footnote is a break from 
Sequence; but it cannot really be extended 
(though some, like Will Cuppy, have toyed 


with the technique). 


I have run into perhaps a dozen people 
who understood this instantly when I talked 
to them about it. Most people, however, act 
more bemused, thinking I'm trying to tell them 
something technical or pointlessly philosoph- 
ical. It's not pointless at all: the point is, 
writers do better if they don't have to write 
in sequence (but may create multiple struc- 
tures, branches and alternatives), and readers 
do better if they don't have to read in seq- 
uence, but may establish impressions, jump 
around, and try different pathways until they 
find the ones they want to study most closely. 


in the French play who was surprised to learn 
that he had been "speaking prose all his life 
and never known it"), we've been speaking 
hypertext all our lives and never known it. 


Now, many writers have tried to break 
away from sequence. I think of Nabokov's 
Pale Fire, of Tristram Shandy and an odd novel 
of Lazaro Cortazar called Ho scotch, made up 
of sections ending with numbers telling you 
where you can branch to. There are many more; 
and large books generally use many tricks to 
get around the problem of indexing and review- 
ing what has and hasn't been said or done al- 
ready. 


However, in my view, a new day is dawning. 
Computer storage and screen display mean that 
we no longer have to have things in sequence; 
totally arbitrary structures are possible, and 
I think that after we've tried them enough 
people will see how desirable they are. 


TYPES OF HYPERTEXT 


Let's assume that you have a high-power 
display-- and storage displays won't do, be- 
cause you have to see things move in order 
to understand where they come from and what 
they mean. (Especially text.) So it has to 
be a refreshed CRT. 


Basic or chunk style hypertext offers 
choices, either as footnote-markers (like 
asterisks) or labels at the end of a chunk. 
Whatever you point at then cumes to the screen. 


Collateral hypertext means compound an- 
notations or Saratiat text (see p. bmY2). 


Stretchtext changes continuously. This 
requires very unusual techniques (see p.dml7 ), 
but exemplifies how "continuous" hypertext might 
work. 


Ideally, chunk and continuous and collateral 
hypertext could all be combined (and in turn col- 
laterally linked; see "Thinkertoys," p.DA$2). 


A "fresh" or "specific" hypertext-- I don't 
have a better term at the moment-- would consist 
of material especially written for some purpose. 
An anthological hypertext, however, would consist 
of aatertats brought together from all over, like 
an anthological book. 


A grand hypertext, then, folks, would be 
a hypertext consisting of "everything" written 
about a subject, or vaguely relevant to it, 
tied together by editors (and NOT by "prog- 
rammers,'' dammit), in which you may read = 
all the directions you wish to pursue. There 
can be alternative Taare for people who 
think different ways. People who have to 
have one thing explained to them at a time-- 
many have insisted to me that this is normal, 
although I contend that it is a pathological 
condition-- may have that; others, learning 
like true human beings, may gather and sift im- 
pressions until the ideas become clear. 


And then, of course, you see the real 
dream. 


The real dream is for "everything" to be 
in the hypertext. 


Everything you read, you read from the 
screen (and can always get back to right away); 
everything you write, you write at the screen 
(and can cross-link to whatever you read; see 
Canons, p.bM§!). 


Paper moulders. Microfilm is inconvenient. 
In the best libraries it takes at least min-' 
utes to get a particular thing. But as to 
linking them together-- footnoting Aeschylus 
with Marcus Aurelius, linking genetic data’ 
to 15th-century accounts of Indian tribes-- 
well, you can only do it on paper by writing 
something new that ties them together. Isn't 
that ridiculous? When you could do it all: 
electronically in seconds? 


Now that we have all these wonderful de- 
vices, it should be the goal of society to put 
them in the service of truth and learning. 

And this is the way I propose. Not through 
obscure forms of "information retrieval;" not 
through newly oppressive forms of "computer- 
assisted instruction;" and not through a pur- 
ported science of "artifical intelligence" 
that will create new personalisms to irk us. 
All these obstructive oddities, I think, have 
developed as separate ideals because of the 
grand preposterosity of Professionalism that 
has created a world-wide cult of mutual incon- 
prehensibility and disconnected special goals. 
Now we need to get everybody together again. 
We want to go back to the roots of our civil- 
ization-- the ability, which we once had, for 
everybody who could read to be able to read 
everything. We must once again become a com- 
munity of common access to a shared heritage. 


This was of course what Vannevar Bush 
said in 1945 (see 4°%r), in an article every- 
body cites but nobody reads. 


The hypertext solution in many ways ob- 
viates some of these other approaches, and in 
addition retains and puts back together the’ 
great traditions of literature and scholarship, 
traditions based on the fact that dividing 
things up arbitrarily just generally doesn't 
work. 


EVERYTHING IS DEEPLY INTERTWINGLED. 


(The only way in which my views differ 
with those of Engelbart and Pask, I think is 
in the matter of structure and hierarchy. 
Both men generally assume that whatever 
natural hierarchy may exist in particular 
subjects needs to be accentuated; I hold that 
all structures must be treated as totally ar- 
bitrary, and any hierarchies we find are inter- 
esting accidents.) 


CAN IT BE DONE? 
I dunno. 


Licklider, one of computerdom's Great Men, 
estimated in 1965 that to handle all text by — 
computer, and bring it out to screens, would 
cost no more than what we pay for all text 
handling now. (But of course there is the 
problem of what to do with the people whose 
lives are built around paper; that can't be 
taken up here.) 


The people who make big computers say 
that to get the big disk storage to hold great 
amounts of text, you have to get their biggest 
computers. Which is a laugh and a half. One 
IBM-style computer person pompously told me 
that for large-scale text handling the only 


appropriate machine was an IBM 360/67 (a shame- 


fully large computer). Such people seem not 
to understand about minicomputers or the po- 
tential of minicomputer networks-- using, of 
course, big disks. 


There are of course questions of relia- 
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EVERYTHING 
IS SEEPLY INTERTWINGCED. 


In an tmportant sense there are 
no "subjects" at all; there ts only 
all knowledge, since the cross- 


connections among the myriad topics 
of thts world stmply cannot be 
divtded up neatly. 


bility, of "big brother" (see Canons, p. a. 
and so on. But I think these.matters can be 
handled. 


Hypertext at last offers the posstbiltity 
of representing and exploring it all 
without carving itt up destructively. 


The key is that people will pay for it. 
I am sure that if we can‘bring the cost down 
to two dollars an hour-- one for the local 
machine (more than a "terminal"), one for the 
material (including storage, transmission and 
copyrights)-- there's a big, big market. (And 
that's what the Xanadu network is about; see 
p.-)MS7.) My assumption is that the way to do 
this is not through big business (since all 
these corporations can see is other corpora- 
tions); not through government (hypertext is 
not committee-oriented, but individualistic-- 
and grants can only be gotten through sesqui- 
pedalian and obfuscatory pompizzazz); but 
through the byways of the private enterprise 
system. I think the same spirit that gave us 
McDonald's and kandy kolor hot rod accessories 
may pull us through here. (See Xanadu Network, 


Arthur C. Clarke wrote a book entitled 
The Lost Worlds of 2001 (Signet, £972); 
about the variants and alternatives of 
that story that did not find their way 
to the screen. 


In a hypertext version, we could look 
at them all in context, in collateral 
views, and see the related variants-- 
with annotations. 


p- dwS)-) 
Obviously, putting man's entire heritage Qyeta 1s vopk ceremonies 
into a hypertext is going to take awhile. But 7 .o) 


it can and should be done. 


BIBLIOGRAPHY . 
Mortimer J. Adler, the wan who reduced all of 


Western Culture to a few Great Books plus an index 
under his own categories, has now Addled the 


Encyclopedia Britannica. 


Theodor H. Nelson, "The Hypertext." Proc. 
World Documentation Federation, 1965. 


Since 1965 he has been creating Britannica 3, 
the venturesome and innovative new version, now on 
sale for about half a thou. 
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Consider the hypertext character of-~ 
Tristram Shandy, by Sterne. 
Spoon River Anthology, by Masters. 
Hopscotch, by Cortazar. 
Pale Fire, by Nabokov. 
Remembrance of Things Past, by Proust. 
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And, surprisingly, hypertext actually 
FIGURES IN Giles Goat-Boy, by Barth. 


Britannica 3 is basically a 3-level hypertext, 
made to fit on printed Pages by the strictures of 
Adler's editing (according to Newsweek, some 200 
authors withdrew their work rather than submit to 


the kind of restrictions he was imposing). 


The idea may be basically good, even though 
the sesquipaedalian titles may impaed the raeder. 


THE BURNING .BUSH 


In fact hypertexts were foreseen very 
clearly in 1945 by Vannevar Bush, Roosevelt's 
science advisor. When the war was in the bag, 
he published a little article on various groovy 
things that had become possible by that time. 


"As We May Think" (Atlantic Monthly, Jul 
1945) is most notable for its clear SeseMiptiok 
of various hypertext techniques-- that is, link+ 
ages between documents which may bé brought rap-: 
idly to the screen according to their linkages. 
(So what if he thought they'd be on microfilm. ) 


GLINDA'S MAGIC BOOK 


Glinda the Good, gentle sorceress of the 
southern quadrant of the land of Oz-- not the 
flaphead portrayed by Billie Burke in the 
Goldwynized film-- has.a Magic Book [In which 
Everything That Happens is written. 


How characteristic of Professionalism. 
Bush's article has been taken as the starting 
point for the field of Information Retrieval — 
(see p. ), but its actual contents have been 
lgnored by acclamation. Information Retrieval 
folk have mostly done very different things, yet 
thought they were in the tradition. 


The question, of course, is how It's 
chosen. 


You can only watch news tickers for a 


short time before getting very bored. Now.people are "rediscovering" the article. 


If there's another edition of this book I hope 
I can fun it in entirety. 


v8 


TYPES OF HYPERTEXT 


Let's assume that you have a high-power 
display-- and storage displays won't do, be- 
cause you have to see things move in order 
to understand where they come from and what 
they mean. (Especially téxt.) So it*’has te 
be a refreshed CRT. 


Basic or chunk style hypertext offers 
choices, either as footnote-markers (like 
asterisks) or labels at the end of a chunk, 
Whatever you point at then comes to the screen. 


Collateral hypertext means compound an- 
notations or parallel text (see p. bm Y2). 


Stretchtext changes continuously. This 
requires very unusual techniques (see p-dm'7 ), 
but exemplifies how "continuous" hypertext might 
work, 


Ideally, chunk and continuous and collateral 
hypertext could all be combined (and in turn col- 
laterally linked; see "Thinkertoys," p-9AS$2). 


A "fresh" or "specific" hypertext-- I don't 
have a better term at the moment-- would consist 
of material especially written for some purpose. 
An anthological hypertext, however, would consist 
of aarerists brought together from all over, like 
an anthological book. 


A grand hypertext, then, folks, would be 
a hypertext consisting of "everything" written 
about a subject, or vaguely relevant to it, 
tied together by editors (and NOT by "prog- 
rammers," dammit), in which you may read in 
all the directions you wish to pursue. There 
can be alternative pathways for people who 
think different ways. People who have to 
have one thing explained to them at a time-- 
many have insisted to me that this is normal, 
although I contend that it is a pathological 
condition-- may have that; others, learning 
like true human beings, may gather and sift im- 
pressions until the ideas become clear. 


And then, of course, you see the real 
dream, 


The real dream is for "everything" to be 
in the hypertext. 


Everything you read, you read from the 
screen (and can always get back to right away) ; 
everything you write, you write at the screen 
(and can cross-link to whatever you read; see 
Canons, p.bMS2). 


Paper moulders. Microfilm is inconvenient. 
In the best libraries it takes at least min-' 
utes to get a particular thing. But as to 
linking them together-- footnoting Aeschylus 
with Marcus Aurelius, linking genetic data 
to 15th-century accounts of Indian tribes-- 
well, you can only do it on paper by writing 
something new that ties them together. Isn't 
that ridiculous? When you could do it all 
electronically in seconds? 


Now that we have all these wonderful de- 
vices, it should be the goal of society to put 
them in the service of truth and learning. 

And this is the way I propose. Not through 
obscure forms of "information retrieval;" not 
through newly oppressive forms of "computer- 
assisted instruction;" and not through a pur- 
ported science of "artifical intelligence" 
that will create new personalisms to irk us. 
All these obstructive oddities, I think, have 
developed as separate ideals because of the 
grand preposterosity of Professionalism that 
has created a world-wide cult of mutual incom- 
prehensibility and disconnected special goals. 
Now we need to get everybody together again. 
We want to go back to the roots of our civil- 
ization-- the ability, which we once had, for 
everybody who could read to be able to read 
everything. We must once again become a com- 
munity of common access to a shared heritage. 


This was of course what Vannevar Bush 
said in 1945 (see 4%/S.r), in an article every- 
body cites but nobody reads. 


The hypertext solution in many ways ob- 
viates some of these other approaches, and in 
addition retains and puts back together the 
great traditions of literature and scholarship, 
traditions based on the fact that dividing 
things up arbitrarily just generally doesn't 
work. 


EVERYTHING IS DEEPLY INTERTWINGLED. 


(The only way in which my views differ 
with those of Engelbart and Pask, I think is 
in the matter of structure and hierarchy. 
Both men generally assume that whatever 
natural hierarchy may exist in particular 
subjects needs to be accentuated; I hold that 
all structures must be treated as totally ar- 
bitrary, and any hierarchies we find are inter- 
esting accidents.) 


CAN IT BE DONE? 


I dunno. 


Licklider, one of computerdom's Great Men, Pi 


estimated in 1965 that to handle all text by 
computer, and bring it out to screens, would 
cost no more than what we pay for all text 
handling now. (But of course there is the 
problem of what to do with the people whose 
lives are built around paper; that can't be 
taken up here.) 


The people who make big computers say 


that to get the big disk storage to hold great 
amounts of text, you have to get their biggest 


computers. Which is a laugh and a half. One 
IBM-style computer person pompously told me 
that for large-scale text handling the only 


appropriate machine was an IBM 360/67 (a shame- 


fully large computer). Such people seem not 
to understand about minicomputers or the po- 
tential of minicomputer networks-- using, of 
course, big disks. 


There are of course questions of relia- 
bility, of "big brother" (see Canons, p. ) 
and so on. But I think these,matters can be 
handled. 


The key is that people will pay for it. 
I am sure that if we can ‘bring the cost down 
to two dollars an hour-- one for the local 
machine (more than a "terminal"), one for the 
material (including storage, transmission and 
copyrights)-- there's a big, big market. 
agg the Xanadu network is about; see 
p- )MS7.) 
this is not through big business (since all 
these corporations can see is other corpora- 
tions); not through government (hypertext is 
not committee-oriented, but individualistic-- 
and grants can only be gotten through sesqui- 
pedalian and obfuscatory pompizzazz); but 
through the byways of the private enterprise 
system. I think the same spirit that gave us 
McDonald's and kandy kolor hot rod accessories 
may pull us through here. 


Pp. SKS)-) 


Obviously, putting man's entire heritage 
into a hypertext is going to take awhile. 
it can and should be done. 
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COULDN'T HAVE HYPERTEXT NOVELS, YOU SAY? 


Consider the hypertext character of-~ 
Tristram Shandy, by Sterne. 
Spoon River Anthology, by Masters. 
Hopscotch, by Cortazar. 
Pale Fire, by Nabokov. 
Remembrance of Things Past, by Proust. © 


And, surprisingly, hypertext actually 
FIGURES IN Giles Goat-Boy, by Barth. 


GLINDA'S MAGIC BOOK 


Glinda the Good, gentle sorceress of the 
southern quadrant of the land of Oz-- not the 
flaphead portrayed by Billie Burke in the 
Goldwynized film-- has.a Magic Book in which 
Everything That Happens is written. 


The question, of course, is how it's 
chosen. 


You can only watch news tickers for a 
short time before getting very bored. 


My assumption is that the way to do 


(See Xanadu Network, 
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IS DEEPLY INTERTWINGLED. 


In an tmportant sense there are 
no "subjects" at all; there ts only 
all knowledge, since the cross- 
connections among the myrtad topics 
’ of this world simply cannot be 
divtded up neatly. 


Hypertext at last offers the posstbiltity 
of representing and exploring tit all 
without carving tt up destructively. 


(And 


Arthur C. Clarke wrote a book entitled 
The Lost Worlds of 2001 (Signet, 1972), 
about the variants and alternatives of 
that story that did not find their way 
to the screen. 


In a hypertext version, we could look 
at them all in context, in collateral 
views, and see the related variants-- 
with annotations. 


Mortimer J. Adler, the man who reduced all of 
Western Culture to a few Great Books plus an index 
under his own categories, has now Addled the 


Encyclopedia Britannica. 


Since 1965 he has been creating Britannica x, 
the venturesome and innovative new version, now on 
sale for about half a thou. 
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Britannica 2 is basically a 3-level hypertext 
made to fit on printed pages by the strictures of 
Adler's editing (according to Newsweek, some 200 
authors withdrew their work rather than submit to 
the kind of restrictions he was imposing). 


The idea may be basically good, even though 
the sesquipaedalian titles may impaed the raeder. 


THE BURNING .BUSH 


In fact hypertexts were foreseen very 
clearly in 1945 by Vannevar Bush, Roosevelt's 
Science advisor. When the war was in the bag, 
he published a little article on various groovy 
things that had become possible by that time. 


"As We May Think" (Atlantic Monthl Jul 
1945) is most notable for its clear Seeetintica 
of various hypertext techniques-- that is, link- 
ages between documents which may bé brought rap-" 
idly to the screen according to their linkages. 
(So what if he thought they'd be on microfilm.) 


How characteristic of Professionalism. 
Bush's article has been taken as the starting 
point for the field of Information Retrieval © 
(see p. ), but its actual contents have been 
ignored by acclamation. Information Retrieval 
folk have mostly done very different things, yet 
thought they were in the tradition. 


Now people are "rediscovering" the article. 
If there's another edition of this book I hope 
I can fun it in entirety. 
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ENGELBART AND 


"THE KUGMENTATION 
OF INTELLECT" 


Douglas Engelbart is a saintly man at 
Stanford Research Institute whose dream has 
been to make people smarter and bring them 
together. His system, on which millions of 
dollars have been spent, is a wonder and a 
glory. 


He began as an engineer of CRTs (see 
"Lightning in a Bottle," p.DM6); but his 
driving thought was, quite correctly, that 
these remarkable objects could be used to 
expand man's mind and improve each shining 
hour. 


Doug Engelbart's vision has never been 
restricted to narrow technical issues. From 
the beginning his concern was not merely to 
plank people down at display consoles, but 
in the most profound sense to expand man's 
mind. "The Augmentation of Human Intellect," 
he calls it, by which he means making minds 
work better by giving them better tools to 
work with. 


An obvious example is writing: before 
people could write things down, men could 
only learn what they experienced or were 
told by others in person; writing changed 
all that. Within the computer-screen fra- 
ternity, the next step is obvious; screens 
can double and redouble our intellectual 
capacities. But this is not obvious to every- 
body. Engelbart, patiently instructing those 
outside, came up with a beautiful example. 

To show what he meant by the Augmentation of 
Intellect, Engelbart tied a pencil to a brick. 
Then he actually made someone write with it. 
The result, which was of course dreadful, En- 
gelbart solemnly put into a published report. 
Not yet being able to demonstrate the aug- 
mentation of intellect, since he had as yet 
no system to show off, he had masterfully de- 
monstrated the disaugmentation of intellect: 
what happens if you make man's tools for work- 
ing out his thoughts worse instead of better. 
As this poor guy was with his brickified pen- 
cil, explained Engelbart, so are we all among 
our bothersome, inflexible systems of paper. 


Starting small, Engelbart programmed up 
a small version of what most fans call "The 
Engelbart System" some ten years ago. One 
version has it that when it came to looking 
for grants, management thought he acted too 
kooky, and so assigned a Front Man to make 
the presentation. But, as the story goes, 
the man from ARPA (see "Military...", p. 59) 
pointed at Engelbart and said, "We want to 
back him." 


A small but dedicated group at SRI has 
built up a system from scratch. First they 
used little CDC 1700 minicomputers; then, 
various grants later, they were able to set 
up their own PDP-10, in which the system now 
resides, and from which it reaches out ac- 
ross the country. 


Doug calls his system NLS, or “oN-Line 
System." Basically it is a highly responsive, 
deeply-structured text system, feeding out to 
display terminals. From a terminal you may 
read anything you or others have written, and 
write with as-yet-unmatched flexibility. 


The display terminals are all over. The 
project has gone national, though at great ex- 
pense: through the ARPA net of computers, you 
can in principle become a user of NLS for 
something like $50,000 a year. 


THE "KNOWLEDGE WORKSHOP" 


For a lucky fifty or so people, Engelbart's 
system is Home. Wherever they are-- at Stan- 
ford Research Institute or far away on the 
ARPAnet-- a whole world of secretarial and 
communication services is at their fingertips. 
The user has but to call up through his dis- 
play terminal and log on. At that point all 
his written files, and numerous files shared 
among the users, are at his fingertips. He 
may read, write, annotate the cross-link. 
(Engelbart's system has provision for col- 
lateral structuring: see "Thinkertoys," p52.) 
He may send messages to others in the Workshop. 
He may open certain of his files to other 
pecple, and read those that have been opened 
to him. 


This all has a certain vagueness if you 
do not understand how bound you are today by 
paper-- the problems of finding it, sorting 
it, looking things up. (If you write, that 
is, write a lot, you know all too well how 
intractable is paper, what a damned nuisance.) 
With a system like Engelbart's, now, whatever 
is written is instantly there. Whatever you 
want to look up is instantly there, simultan- 
eously interconnected to everything else it 
should be connected to-- source materials, 
footnotes, comments and so on. A document is 
completed the moment it is written: no human 
being has to retype it. (It need not be typed 
on paper at all, if it's just for the workshop 
members: a printout is only needed if it has 
to go to someone outside the system.) 


In many ways, Engelbart's system is a pro- 
totype for the world of the future, I hope. 
ALL HANDLING OF PAPER IS ELIMINATED. Whatever 
you write, you write on the screens with key- 


board and pointer. (No more backs of envelopes, 


yellow pads, file cards, typewriters.) What- 


ever you transmit to fellow users of the system 
you simply 'release'-- no physical papet changes 


hands. 


The group has also worked out some remark- 
able techniques for collaborative endeavor. 
Two people-- say, one in California and one in 
New York-- can work together through their 
screens, plus a phone link; it's as if they 
were side-by-side at a magic table. Each sees 


on his screen what the other sees; each controls 
a moving dot (or "cursor') that shows where he's 


pointing. The effect is somewhere between a 
blackboard and a desk; both may call up docu- 
ments, point things out in them, change them, 


and anything else two people might do when work- 


ing on something together. 


Engelbart meets with someone 
far away, as others watch. 


THE SYSTEM ITSELF 


Basically the system is a large-scale setup 
for the storage, bringing forth, viewing and 
revision of documents and connections among them. 


The documents are stored (of course) in 
alphabetical codes. Connections among them, 
or other relations within them, are signalled 
by the presence of other codes within them; 
these are ordinarily not displayed, however, 
except as directed by a particular display 
program and display programs can of course 
vary. 


There are various programs for display, 
in large part depending on what sort of 
screen system the individual user has. 
(NLS is used with everything from high-reso- 
lution line-drawing screens converted to 1000- 
line television, down to inexpensive Delta 
Data terminals-- a brand, incidentally, that 
allows text motion, which most don't.) Engel- 
bart's system is extremely general, allowing 
the creation of files having all kinds of 
structures, and display programs in all kinds 
of styles. (I hope that this side of the pre- 
sent book conveys a sense of how many styles 
that can be.) However, most users are devoted 
to certain standardized styles of working that 
have been well worked out and permit the easy 
sharing of material and of operating practices. 
Here, for instance, is "Standard screen layout: 


VICW INDICATORS YOUR CURRENT COMMANDS Bhd NLS 
— fells wha 


you're a) af 


(WHAT You TYPE IN 
MAY BE EXAMINED HERE) 


FILE WINDOW L 


Ce ee 


FILE WIN DoW 2 


Two separate panels of text appear, and links 
may be shown on them. (Thus it's a thinkertoy-- 
see p. -) Two little windows at the top re- 
mind you of what you're seeing and what you're 
asking for. We can't get into the rest of it 
here 


THE COMMAND LANGUAGE 


NLS has a command language which all 
users must learn. While it is a stream- 
lined and straightforward command language, 
nevertheless it requires the user to type 
in a specific sequence of alphabetical 
characters every time he wants something 
done. (This is acceptable to computer- 
oriented people; I suspect it would not 
be satisfactory, say, for philosophers 
and novelists. For designs oriented to 
such users, see JOT (p?"50 ) and Carmody's 
System, nearby, Parallel Textface (po"S3) 
and Th3 (p. Sv ).) 


Incidentally, NLS users may also employ 
a cute little keyboard, something like a 
kalimba, that allows you to type with one 
hand. You simply type the six significant 
ASCII bits (see chart p. 2§) in one "chord" 
-—- it sounds hard but is easy to learn. 


Sample commands: I (insert), D (delete), 
M (move or rearrange). Then you point with 
the mouse. 


MOUSE? 


The Engelbart Folks have built a pointing 
device, for telling the system where you're 
pointing on the screen, that is considerably 
faster and handier than a lightpen. (Unfor- 
tunately, I don't believe it's commercially 
available.) It's called The Mouse. 


The Engelbart Mouse is a little box with 
hidden wheels underneath and a cable to the 
terminal. As you roll it, the wheel's turns 
are signalled to the computer and the comput-— 
er moves the cursor on the screen. It's fast 
and accurate, and in fact beats a lightpen 
hands down in working speed. 


Through the command language, NLS allows 
users to create programs that respond in all 
sorts of ways; thus the fact that certain texi- 
handling styles are standard (as in above il- 
lustration of screen layout) results more from 
tradition than necessity. 


The same apparently is true of the data 
structure. I used to be somewhat disturbed 
at the way Engelbart's text systems seem to 
be rigorously hierarchical. This in fact is 
the case, in the sense that having multiple 
discrete levels is built deep into the system. 
But it turns out to be harmless. The stored 
text is divided by the storage techniques in- 
to multiple levels, corresponding to a Harvard 
outline. Think of it as something like this: 


1. HIERARCHICAL FORMAT 


A. STORAGE 
B. DISPLAY 
C. LANGUAGE 


But let's expand this example a little: 


1. HIERARCHICAL FORMAT 
A. STORAGE 

Al. Everything in NLS is stored 
with hierarchical codes. 

A2. Their effect depends on the 
display. 

B. DISPLAY 

Bl. The hierarchical codes of 
NLS have no consequences in 
particular. 

B2. The hierarchical codes for 
NLS can splay the material 
out into a variety of dis- 
play arrangements. 

B2A. They can be displayed 
in outline form. 

B2B. They can be displayed 
in normal text forn. 

B2C. These dratted numbers 
can even be made to 
disappear. 

C. LANGUAGE 

Cl. The command language deter- 
mines what the display shows 
of the hierarchical structure. 

C2. What is shown can be deter- 
mined by a program in the 
command language. (For in- 
stance, “how many levels 
down" it is being shown). 
C2A. This is four levels 

down. (The earlier 
example wasn't.) 

C3. The display format all der 
pends on what display pro- 
gram you use, in the NLS 
command language. 


That's enough of that. I can't help re- 
marking that I still don't like that sort of 
structuring, but it is deep in NLS, and if 
you don't like it either (poor deprived lucky 
user of NLS) you can program it to disappear, 
so it's hardly in your way. 


BY THE BEARD OF THE PROPHET! 


Engelbart in German means Angelbeard; Doug 
Engelbart is indeed on the side of the angels. 
In building his mighty system he points a new 
way for humanity. The sooner the better. Any 
history of the twentieth century will certainly 
hold him high. Few great men are also such 
nice guys. 
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The Augmentation of Intellect. Infamous Ape Sequence from my slide-show. 


h VERY BASIC. HRPERTEXT SYSTEM 


Hypertext is non-sequential writing. It's no good to us, 
though, unless we can go instantly in a choice of directions 
from a given point. 


This of course can only mean on computer display screens. 


Engelbart's system, now, was mainly designed for people who 
wanted to immerse themselves in it and learn its conventions. 
Indeed, it might be said to have been designed for a community 
of people in close contact, a sort of system of blackboards and 
collaborative talking papers. 


A more elemental system, with a different slant, was put 
together at Brown U. on IBM equipment. We'll refer to it here 
as "Carmody's System," after the young programmer whose name 
came first on the writeup. 


Carmody's system runs on an IBM 360 with 2250 display. 
While the 2250 is a fine piece of equipment, the quirks of the 
360's operating system (see p. 4¥$ ) often delay the user by 
making him wait, e.g., for someone else's cards to get punched 
before it responds to his more immediate uses; this is like 
Making ice-skaters wait for oxcarts. 


Anyway, the system essentially imposes no structure on 
the material; it may consist of text segments of any length 
and ties and links between them. An asterisk appearing any- 
where in one piece of text signals a possible jump, but the 
reader doesn't necessarily know where to; zapping the asterisk 
with the lightpen takes you there, however. 


This is stark and simple. It could also get you good 
and lost. However, a simple technique took care of that: 
nae eee the user jumped, the address of his previous 
location was saved on a stack (see "The Magic of the Stack," 
p- ‘2). The user also had a RETURN button: when he wanted 
to go back to where he had last jumped from, the system 
would pop the last address off the top of the stack, and 
take him there. (This feature was adapted from my 1967 
Stretchtext paper, and turned out to work out quite well 
in practice.) 


The system also had handy features for light-pen text 
editing, and various nice printout techniques. All told, 
it was a clean and powerful design. While it lacked higher- 
level visualization facilities, like Engelbart's display of 
Levels (see "outline" in Engelbart article) or collateral 
display (see "Thinkertoys," pDAS2), it was in some ways suited 
for naive users; that is, it was eventually fairly safe to use, 
and could in large part be taught to rank beginners in a couple 
of hours-- provided they didn't have to know about JCL cards. 


It is left for the reader to figure out interesting uses 
for it. How would you do collateral structures? How could 
you signal to a reader which of several pieces of text a jump 
was to? 


(At least one real hypertext was actually written on this 
system. It tied together a lot of patents for multilayer elec- 
trodes. Readers agreed that they could learn more from it about 
multilayer electrodes than they had imagined wanting to know.) 
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ROOK] PASK ReTRNS [seers 


This continues the remarks on Gordon Pask 
begun on p. 


I will now try to describe Pask's work 
as he has explained it to me. Perhaps this 
will be of some help to those who may have 
been mystified or dumfounded by contact with 
this fabulous man. 


Gordon Pask's concern is abstraction and 
how concepts are formed, whether in a creature 
of nature or a robot or a computer program. 
Abstraction is of interest primordially (as life 
evolved thinking capacity), psychogenetically 
(as the mind acquires new facilities, described 
most peculiarly by Piaget), and epistemological- 
ly (how do we know? Like, how do we know, man?), 


and methodologically (how can we most effectively 
find out more?). : 


His interest, then, is in teaching by 
allowing students to discover exact relations 
in a specific subject matter by the very pro- 
cess of abstraction that is of so much interest. 
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What he does, then, is prepare given 
fields of learning so that they can be studied 
by students using abstractive. methods, without 
guidance, : 


This preparation basically has two steps. 
First he sets up the whole field. This is 
done in collaboration with a "subject matter 
expert," who names the important topics in 
the field and states what interconnections 
they have. The result is a complex graph 
structure (see p. ?@6 ) which Pask calls a 
conversational domain. It comes out to huge 


diagrams of labels and lines between them. 


Then: Pask processes this structure to 
make a more usable map of the field that he 
calls an entailment structure. The processing 
basically involves removing "cycles" in the 
graph, thus making the structure hierarchical 
in a slightly artificial way justified by what 
the subject-matter-expert has said is the 
structure of the field. 


(This processing is carried out by a pro- 
gram called EXTEND.) 


The resulting Entailment Structure is 
then presented to the student as a great map 
of the field which he may explore. 


Pask intends that the student's explor- 
ations. will consist of testing analogies, or 
what Pask calls morphisms, to find the exact 
structures of knowledge he is supposed to 
be acquiring. This knowledge will be in the 
form of isomorphisms, or exact analogies, i.e. 
laws. 


Pask's overall system, examples of which 
he has running in his laboratory in England, 
he calls CASTE (Course Assembly System and 
Tutorial Environment). A further development, 
which is to be put on a PDP-11/45 computer 
(see p. Sf6 and p.4Y2 ) at the Brooklyn Chil- 
dren's Museum, is called THOUGHT-STICKER. 

This program is intended to allow the demon- 
stration and testing of analogies directly, 
by children. 


PASK AND HYPERTEXT 


Gordon Pask's work is remarkably similar 
to my own stuff on hypertext. 


Essentially Pask is reducing a field to 
an extremely formal structure of relations 
which may then be studied by the student, at 
the student's initiative. mate 


(What I don't quite understand is how the 
analogies are to be explored and tested.) 


Anyway, a principal point is that the 
student is in control and may use his initia- 
tive dynamically; the subject is not artifi- 
cially processed into a presentational se- 
quence. Moreover, the arbitrary interconnec- 
tions of the subject, which are no respecters 
of the printed page, are recognized as the 
fundamental structures the student must deal 
with and come to understand. On all these 
points Pask and I are in total agreement. 


Indeed, his explorable systems-- (I don't 
know if they will be what I elsewhere call 
hypergrams or responding resources)-- will be 
fascinating, fun and terrifically educational. 
Because he is. 


Now it turns out that this exactly com- 
plements the notion of hypertext as I have been 
promulgating it lo these many years. 


Hypertext is non-sequential text. If we 
write a hypertext on something, it will be 
most appropriate if we give it the general 
interconnective structure of the field. In 
other words, the interconnective structures 
chosen for the textual parts are likely to have 
the same connective structure (in general) as 
Pask's Entailment Structure. 


For another kind of hypertext, the antho- 
logical hypertext built up of lots of other 
writings, it is also reasonable to expect the 
connective structures to cluster to the same 
general form as Pask's entailment structure. 


In other words, the very same field of 
knowledge Pask is out to represent as an ex- 
plorable, formalized whole, I am out to repre- 
sent as an explorable informalized whole, with 
anecdotes, jokes, cartoons, "enrichment mater- 
ials,'"' and anything else people might dig. 


In still other words, let's have both 
and call it a party. 


You can't read the screen here. 
It says: COGITO ERGO SUM 

e=me2 

Call me Ishmael. 


Actually it needs 


It really needs the music. 
the '2001' music. 


z8 
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TEELED- EFFECT SYSTEMS 
ARE THE NEW FRONTIER 


FANTICs 


— BUT IT'S SHOWMANSHIP 
THAT'S PARAMOUNT, 
NOT ANY TECHNICAL SPECIALTY 


Ah, Love! could you and I with Him conspire 

To grasp this sorry Scheme of Things entire, 
Would not we shatter it to bits—and then 

Re-mould it nearer to the Heart’s Desire! 


Edward Fitzgerald. 


Almost everyone seems to agree that Mankind (who?) 
is on the brink of a revolution in the way information 
is handled, and that this revolution is to come from 
some sort of merging of electronic screen presentation 
and audio-visual technology with branching, interactive 
computer systems. (The naive think "the" merging is 
inevitable, as if "the'' merging meant anything clear. 

I used to think that too.) 


Professional people seem to think this merging will 
be an intricate mingling of technical specialties, that 
our new systems will require work by all kinds of commit— 
tees and consultants (adding and adjusting) until the Re- 
sults-- either specific productions or overall Systems—— 
are finished. Then we will have to Learn to Use Them. 
More consulting fees. 


I think this is a delusion and a con-game. I think 
that when the real media of the future arrive, the small- 
est child will know it right away (and perhaps first). 
That, indeed, should and will be the criterion. When you 
can't tear a teeny kid away from the computer screen, 
we'll have gotten there. 


We are approaching a screen apocalypse. The author's 
basic view is that RESPONSIVE COMPUTER DISPLAY SYSTEMS 
CAN, SHOULD AND WILL RESTRUCTURE AND LIGHT UP THE MENTAL 
LIFE OF MANKIND. (For a more conventional outlook, see 
box nearby, "Another Viewpoint.") 


I believe computer screens can make people happier, 
smarter, and better able to cope with the copious prob- 
lems of tomorrow. But only if we do right, right now. 


WHY? 


The computer's capability for branching among 
events, controlling exterior devices, controlling 
outside events, and mediating in all other events, 
makes possible a new era of media. 


Until now, the mechanical properties of exter- 
nal objects determined what they were to us and how 
we used them. But henceforth this is arbitrary. 


The recognition of that arbitrariness, and re- 
consideration among broader and more general alter- 
natives, awaits us. All the previous units and 
mechanisms of learning, scholarship, arts, transac— 
tion and confirmation, and even self-reminder, were 
based in various ways upon physical objects-—- the 
properties of paper, carbon paper, files, books 
and bookshelves. To read from paper you must move 
the physical object in front of you. Its contents 
cannot be made to slide, fold, shrink, become trans- 
parent, or get larger. 


But all this is now changing, and suddenly. The 
computer display screen does all these things if desired, 
to the same markings we have previously handled on paper. 
The computer display screen is going to become universal 
very fast; this is guaranteed by the suddenly rising 
cost of paper. And we will use them for everything. 

This already happens wherever there are responding com- 

puter screen systems. (I have a friend with two CRTs on 
his desk; one for the normal flow of work, and one to 
handle interruptions and side excursions.) A lot of 
forests will be saved. * 

Now, there are many people who don't like this idea,# 
and huff about various apparent disadvantages of the 
screen. But we can improve performance until almost 
everyone is satisfied. For those who say the screens are 
“too small," we can improve reliability and backup, and 
offer screens everywhere (so that material need not be 
physically carried between them). 


The exhilaration and excitement of the coming time 
is hard to convey on paper. Our screen displays will be 
alive with animation in their separate segments of activ- 
ity, and will respond to our actions as if alive physic- 
ally too. ’ 


The question is, then: HOW WILL WE USE THEM? Thus 
the design of screen performances and environments, and 
of transaction and transmission systems, is of the high- 
est priority. 


THE FRENCH HAVE A WORD FOR IT 


In French they use the term 1'Informatique 
to mean, approximately, the presentation or in- 
formation to people by automatic equipment. 


Unfortunately the English equivalent, 
informatics, has been preempted. There is a 
computer programming firm called Informatics, 
Inc., and when I wrote them about this in the 
early sixties they said they did not want their 
name to become a generic term. Trademark law 
supports them in this to a certain extent. 
(Others, like Wally Feurzeig, want that to be 
the word regardless.) But in the meantime 
I offer up the term fantics, which is more 
general anyhow. 


MEDIA 


What people don't see is how computer technology now 
makes possible the revision and improvement—- the trans- 
formation-- of all our media. It "sounds too technical." 


But this is the basic misunderstanding: the funda- 
mental issues are NOT TECHNICAL. To understand this is 
basically a matter of MEDIA CONSCIOUSNESS, not technical 
knowledge. 


A lot of people have acute media consciousness. But 
some people, like Pat Buchanan and the communards, suggest 
that there is something shabby about this. Many think, 
indeed, that we live in a world of false images promulgat- 
ed by "media," a situation to be corrected. But this is 
a misunderstanding. Many images are false or puffy, all 
right, but it is incorrect to suppose that there is any 
alternative. Media have evolved from simpler forms, and 
convey the background ideas of our time, as well as the 
fads. Media today focus the impressions and ideas that 
in previous eras were conveyed by rituals, public gather- 
ings, decrees, parades, behavior in public, mummer' troup- 
es...but actually every culture is a world of images. The 
chieftain in his palanquin, the shaman with his feathers 
and rattle, are telling us something about themselves and 
about the continuity of the society and position of the 
individuals in it. 


Now the media, with all their quirks, perform the 
same function. And if we do not like the way some things 
are treated by the media, in part this stems from not 
understanding how they work. "Media," or structured trans— 
mission mechanisms, cannot help being personalized by 
those who run them. (Like everything else.) The problem 
is to understand how media work, and thus balance our un- 
derstanding of the things that media misrepresent. 


THOUGHTS ABOUT MEDIA: 
1. ANYTHING CAN BE SAID IN ANY MEDIUM. 


Anything can be said in any medium,and Inspiration 
counts much more than 'science'. But the techniques which 
are used to convey something can be quite unpredictable. 


Voice of Little Girl: 
"Santa, are you more important than God?" ? 
Announcer, plonkingly: 


(After How To Be A Department Store Santa Claus, 
produced by the author for CBS Laboratories 
and the AVS-10 instructional device. 

Original slide, starring Michelle Dellinger and 

Henry Shrady, unfortunately mislaid.) 


2. TRANSPOSABILITY 


There has always been, but now is newly, a 
UNITY OF MEDIA OPTIONS. You can get your message 
across in a play, a tract, a broadside, a textbook, 
a walking sandwich~board, a radio program, a comic 
book or fumetti, a movie, a slide-show, a cassette 
for the Audi-Scan or the AVS-10, or even a hypertext 
(see p.hmNG). 


(But transposing can rarely preserve completely 
the character or quality of the original.) 


3. BIG AND SMALL APPROACHES 


What few people realize is that big pictures can 
be conveyed in more powerful ways than they know. The 
reason they don't know it is that they see the content 
in the media, and not how the content is being gotten 
across to them-- that in fact they have been given very 
big pictures indeed, but don't know it. (I take this 
point to be the Nickel-Iron Core of McLuhanism.) 


People who want to teach in terms of building up 
from the small to the large, and others who (like the 
author) like to present a whole picture first, then 
fill in the gaps, are taking two valid approaches. 
(We may call these, respectively, the Big Picture ap- 
proach and the Piecemeal approach.) Big pictures are 
just as memorable as picky-pieces if they have strong 
insights at their major intersections. 


4, THE WORD-PICTURE CONTINUUM 


The arts of writing and diagramming are basically 
a continuum. In both cases the mental images and cogni- 
tive structures produced are a merger of what is heard 
or received. Words are slow and tricky for presenting 
a lot of connections; diagrams do this well. But dia- 
grams give a poor feel for things and words do this 
splendidly. The writer presents exact statements, in 
an accord-structure of buts and indeeds, molded in a 
structure of connotations having (if the writer is 
good) exact impreciseness. This is hardly startling: 
you're always selecting what to say, and the use of 
vague words (or the use of precise~sounding words va- 
guely) is simply a flagrant form of omission. In dia- 
grams, too, the choice of what to leave in and out, how 
to represent overweening conditions and forces and examp- 
lary details, are highly connotative. (Great diagrams 
are to be seen in the Scientific American and older 
issues of TIME magazine.) 


This word-picture continuum is just a part of the 
broader continuum, which I call Fantics. 


"Your answer is..." > 
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PROBLEMS, PERILS, AND PROMISES OF COMPUTER GRAPHICS 


I would begin with some definitions which may be 
obvious but, bear repeating. 


1. Engineering is the application of science for 
($) profit, 

2. Computer graphics does not make possible 
anything that was previously impossible: it 
can only improve the throughput of an existing 
process, 


3. A successful application of computer graphics 
is when over a period of five years the cost 
savings from improved process throughput ex- 
ceed the costs of hardware, software, main- 
oe and integration into an existing process 
ow. 


FANTICS 


By “fantics" I mean the art and science of getting 
ideas across, both emotionally and cognitively. "Presenta- 
tion" could be a general word for it. The character of 
what gets across is always dual: both the explicit struc- 
turesand feelings that go with them. These two aspects, 
exactness and connotation, are an inseparable whole; what 
is conveyed generally has both. The reader or viewer al- 
ways gets feelings along with information, even when the 
creators of the information think that its "content" is 
much more restricted. A beautiful example: ponderous 
"technical" manuals which carry much more connotatively 
than the author realizes. Such volumes may convey to 
some readers an (intended) impression of competence, to 
others a sense of the authors’ obtuseness and non-imagina- 
tion. Explicit declarative structures nevertheless have 
connotative fields; people receive not only cognitive 
structures, but impressions, feelings and senses of things. 


Fantics is thus concerned with both the arts of ef- 
fect-- writing, theater and so on—and the structures and 
mechanisms of thought, including the various traditions of 
the scholarly event (article, book, lecture, debate and 
class )» These are all a fundamentally inseparable whole, 
and technically-oriented people who think that systems to 
interact with people, or teach, or bring up information, 
can function on some “technical” basis-—- with no tie-ins 
to human feelings, psychology, or the larger social struc 
ture-- are kidding themselves and/or everyone else. Sys- 
tems for "teaching by computer," “information retrieval," 
and so on, have to be governed in their design by larger 
principles than most of these people are willing to deal 
with: the conveyance of images, impressions and ideas. 
This is what writers and editors, movie-makers and lectur- 
ers, radio announcers and layout people and advertfsing 
people are concerned with; and unfortunately computer 
people tend not to understand it for beans. 


In fantics as a whole, then we are concerned with: 


1. The art and science of presentation. Thus it na- 
turally includes 


2. Techniques of presentation: writing, stage dir- 
ection, movie making, magazine layout, sound overlay, 
etc. and of course 


3. Media themselves, their analysis and design; 
and ultimately 


4. The design of systems for presentation. This 
will of course involve computers hereafter, both concept- 
ually and technically; since it obviously includes, for the 
future, branching and intricately interactive systems en- 
acted by programmable mechanisms, i.e. computers. Thus 
computer display, data structures (and, to an extent, 
programming languages and techniques) are all a part. 


Fantics must also include 


5. Psychological effect and impact of various presen- 
tational techniques-- but not particular formal aesthetics, 
as of haiku or musical composition. Where directly rele- 
vant fantics also includes 


6. Sociological tie-ins-- especially supportive and 
dysfunctional structures, such as tie~ins with occupational 
structure; sponsorship and commercials; what works in schools 
and why. Most profoundly of all, however, fantics must deal 
with psychological constructs used to organize things: 


7. The parts, conceptual threads, unifying concepts 
and whatnot that we create to make aspects of the world un- 
derstandable. We put them into everything, but standard- 
ize them in media. 


For example, take radio. Given in radio-- the tech- 
nological fundament-- is merely the continuous transmission 
of sound. Put into it have been the "program," the ser- 
ial (and thus the episode), the announcer, the theme song 
and the musical bridge-- conventions: which are useful pre- 
sentationally. 


The arbitrariness of such mental constructs should 
be clear. Their usefulness in mental organization perhaps 
is not. 


Let's take a surprise example, nothing electronic 
about it. 


Many “highways" are wholly fictitious-- at least to 
begin with. Let's say that a Route 37 is created across 
the state: that number is merely a series of signs that 
users can refer to as they look at their maps and travel 
along. 


However, as time goes by, “Route 37" takes on a cer- 
tain reality as a conceptual entity: people think of it 
as a thing. People say "just take 37 straight out" 
(though it may twist and turn); groups like a Route 37 
Merchants’ Association, or even a Citizens to Save Scenic 
,37, may spring up. 


What was originally simply a nominal construct, then, 
becomes quite real as people organize their lives around 
it. 


This:all seems arbitrary but necessary in both high- 
ways and radio. What, then, does it have to do with the 
new electronic media? 


Graphics 


The same apparently is true of the data 
structure. I used to be somewhat disturbed 
at the way Engelbart's text systems seem to 
be rigorously hierarchical. This in fact is 
the case, in the sense that having multiple 
discrete levels is built deep into the system. 
But it turns out to be harmless. The stored 
text is divided by the storage techniques in- 
to multiple levels, corresponding to a Harvard 
outline. Think of it as something like this: 


1. HIERARCHICAL FORMAT 
A. STORAGE 
B. DISPLAY 
C. LANGUAGE 


But let's expand this example a little: 


1. HIERARCHICAL FORMAT 
A. STORAGE 

Al. Everything in NLS is stored 
with hierarchical codes. 

A2. Their effect depends on the 
display. 

B. DISPLAY 

Bl. The hierarchical codes of 
NLS have no consequences in 
particular. 

B2. The hierarchical codes for 
NLS can splay the material 
out into a variety of dis- 
play arrangements. 

B2A. They can be displayed 
in outline form. 

B2B. They can be displayed 
in normal text form. 

B2C. These dratted numbers 
can even be made to 
disappear. 

C. LANGUAGE 

Cl. The command language deter- 
mines what the display shows 
of the hierarchical structure. 

C2. What is shown can be deter- 
mined by a program in the 
command language. (For in- 
stance, “how many levels 
down" it is being shown). 
C2A. This is four levels 

down. (The earlier 
example wasn't.) 

C3. The display format all de- 
pends on what display pro- 
gram you use, in the NLS 
command language. 


That's enough of that. I can't help re- 
marking that I still don't like that sort of 
structuring, but it is deep in NLS, and if 
you don't like it either (poor deprived lucky 
user of NLS) you can program it to disappear, 
so it's hardly in your way. 


BY THE BEARD OF THE PROPHET! 


Engelbart in German means Angelbeard; Doug 
Engelbart is indeed on the side of the angels. 
In building his mighty system he points a new 
way for humanity. The sooner the better. Any 
history of the twentieth century will certainly 
hold him high. Few great men are also such 
nice guys. 
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The Augmentation of Intellect. Infamous Ape Sequence from my slide-show. 


h VCRY BASIC HRPERTEXT SYSTEM 


Hypertext is non-sequential writing. It's no good to us, 
though, unless we can go instantly in a choice of directions 
from a given point. 


This of course can only mean on computer display screens. 


Engelbart's system, now, was mainly designed for people who 
wanted to immerse themselves in it and learn its conventions. 
Indeed, it might be said to have been designed for a community 
of people in close contact, a sort of system of blackboards and 
collaborative talking papers. 


A more elemental system, with a different slant, was put 
together at Brown U. on IBM equipment. We'll refer to it here 
as "Carmody's System," after the young programmer whose name 
came first on the writeup. 


Carmody's system runs on an IBM 360 with 2250 display. 
While the 2250 is a fine piece of equipment, the quirks of the 
360's operating system (see p.4S ) often delay the user by 
making him wait, e.g., for someone else's cards to get punched 
before it responds to his more immediate uses; this is like 
making ice-skaters wait for oxcarts. 


Anyway, the system essentially imposes no structure on 
the material; it may consist of text segments of any length 
and ties and links between them. An asterisk appearing any- 
where in one piece of text signals a possible jump, but the 
reader doesn't necessarily know where to; zapping the asterisk 
with the lightpen takes you there, however. 


* 
. ak 
(R yf 


This is stark and simple. It could also get you good 
and lost. However, a simple technique took care of that: 
a the user jumped, the address of his previous 
location was saved on a stack (see "The Magic of the Stack," 
p. tt). The user also had a RETURN button: when he wanted 
to go back to where he had last jumped from, the system 
would pop the last address off the top of the stack, and 
take him there. (This feature was adapted from my 1967 
Stretchtext paper, and turned out to work out quite well 
in practice.) 


The system also had handy features for light-pen text 
editing, and various nice printout techniques. All told, 
it was a clean and powerful design. While it lacked higher- 
level visualization facilities, like Engelbart's display of 
Levels (see “outline" in Engelbart article) or collateral 
display (see "Thinkertoys," pDAS2), it was in some ways suited 
for naive users; that is, it was eventually fairly safe to use, 
and could in large part be taught to rank beginners in a couple 
of hours-- provided they didn't have to know about JCL cards. 


It is left for the reader to figure out interesting uses 
for it. How would you do collateral structures? How could 
you signal to a reader which of several pieces of text a jump 
was to? 


(At least one real hypertext was actually written on this 
system. It tied together a lot of patents for multilayer elec- 
trodes. Readers agreed that they could learn more from it about 
multilayer electrodes than they had imagined wanting to know.) 


BIBLIOGRAPHY 
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Note: Mr. Gross now goes by the name of Lightning Clearwater. 


GORDON PASK Rees [eect 


This continues the remarks on Gordon Pask 
begun on p. 


I will npw try to describe Pask's work 
as he has explained it to me. Perhaps this 
will be of some help to those who may have 
been mystified or dumfounded by contact with 
this fabulous man. 


Gordon Pask's concern is abstraction and 
how concepts are formed, whether in a creature 
of nature or a robot or a computer program. 
Abstraction is of interest primordially (as life 
evolved thinking capacity), psychogenetically 
(as the mind acquires new facilities, described 
most peculiarly by Piaget), and epistemological- 
ly (how do we know? Like, how do we know, man?), 
and methodologically (how can we most effectively 
find out more?). 


His interest, then, is in teaching by 
allowing students to discover exact relations 
in a specific subject matter by the very pro- 
cess of abstraction that is of so much interest. 


Actually tt needs 
the '2001' mustec. 
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What he does, then, is prepare given 
fields of learning so that they can be studied 
by students using abstractive. methods, without 
guidance. 


This preparation basically has two steps. 
First he sets up the whole field. This is 
done in collaboration with a "subject matter 
expert,'' who names the important topics in 
the field and states what interconnections 
they have. The result is a complex graph 
structure (see p. 26 ) which Pask calls a 
conversational domain. It comes out to huge 


diagrams of labels and lines between them. 


Then: Pask processes this structure to 
make a more usable map of the field that he 
calls an entailment structure. The processing 
basically involves removing "cycles" in the 
graph, thus making the structure hierarchical 
in a slightly artificial way justified by what 
the subject-matter-expert has said is the 
structure of the field. 


(This processing is carried out by a pro- 
gram called EXTEND.) 


The resulting Entailment Structure is 
then presented to the student as a great map 
of the field which he may explore. 


Pask intends that the student's explor- 
ations. will consist of testing analogies, or 
what Pask calls morphisms, to find the exact 
structures of knowledge he is supposed te 
be acquiring. This knowledge will be in the 
form of isomorphisms, or exact analogies, i.e. 
laws. 


Pask's overall system, examples of which 
he has running in his laboratory in England, 
he calls CASTE (Course Assembly System and 
Tutorial Environment). A further development, 
which is to be put on a PDP-11/45 computer 
(see p. S56 and p.4Y2 ) at the Brooklyn Chil- 
dren's Museum, is called THOUGHT-STICKER. 

This program is intended to allow the demon- 
stration and testing of analogies directly, 
by children. 


PASK AND HYPERTEXT 


Gordon Pask's work is remarkably similar 
to my own stuff on hypertext. 


Essentially Pask is reducing a field to 
an extremely formal structure of relations 
which may then be studied by the student, at 
the student's initiative. ey ii 


(What I don't quite understand is how the 
analogies are to be explored and tested.) 


Anyway, a principal point is that the 
student is in control and may use his initia- 
tive dynamically; the subject is not artifi- 
cially processed into a presentational se- 
quence. Moreover, the arbitrary interconnec- 
tions of the subject, which are no respecters 
of the printed page, are recognized as the 
fundamental structures the student must deal 
with and come to understand. On all these 
points Pask and I are in total agreement. 


Indeed, his explorable systems-- (I don't 
know if they will be what I elsewhere call 
hypergrams or responding resources)-- will be 
fascinating, fun and terrifically educational. 
Because he is. 


Now it turns out that this exactly conm- 
plements the notion of hypertext as I have been 
promulgating it lo these many years. 


Hypertext is non-sequential text. If we 
write a hypertext on something, it will be 
most appropriate if we give it the general 
interconnective structure of the field. In 
other words, the interconnective structures 
chosen for the textual parts are likely to have 
the same connective structure (in general) as 
Pask's Entailment Structure. 


For another kind of hypertext, the antho- 
logical hypertext built up of lots of other 
writings, it is also reasonable to expect the 
connective structures to cluster to the same 
general form as Pask's entailment structure. 


In other words, the very same field of 
knowledge Pask is out to represent as an ex- 
plorable, formalized whole, I am out to repre- 
sent as an explorable informalized whole, with 
anecdotes, jokes, cartoons, "enrichment mater- 
ials,'' and anything else people might dig. 


In still other words, let's have both 
and call it a party. 


You can't read the sereen here. 
It says: COGITO ERGO SUM 
e=me2 

Call me Ishmael. 


LE 


, 
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Simply this: till now the structures of media somehow 
sprang naturally from the nature of things. Now they don't 
anymore. Radio, books and movies have a natural inner dy- 
namic of their own, leading to such constructs. While 
this may prove to be so for computer media as well (--as I 
argued in "Getting It Out of Our System," cited p.bMIS), 
then again it may not. In other words, WE MUST ACKNOWLEDGE 
THAT WE ARE INVENTING PRESENTATIONAL TECHNIQUES IN THE NEW 
MEDIA, not merely transporting or transposing particular 
things into them because they seem right. The psychologi- 
cal constructs of man-machine systems may turn out to be 
largely arbitrary. Thus bringing to terminal systems con- 
ventions like dialogue instruction ("CAI"), or arbitrary 
restrictions of how things may be connected, presented or 
written on the computer may be a great mistake. 


The highway-number analogy continues. The older 
highways had numbers for convenience, and our travels be- 
came organized around them, and particular highways (like 
"U.S. 1" and "Route 66") came to have special character. 
But now with the Interstates, a highway is a planned, 
sealed unit, no longer just a collection of roads gather- 
ed together under a name. 


This unit, the Interstate, is not merely a psychologi- 
cal construct, but a planned structure. Knowing what works 
and what doesn't in the design of fast highways, the Inter- 
states were built for speed, structured as closed units. 
Designing them with limited access has been a conscious 
decision in the system design for well~based reasons, not 


‘a chance structure brought in from horse-and buggy days. 


Now, the constructs of previous media-—— writing, films, 
other arts-- evolved over time, and in many cases may have 
found their way to a "natural" form. But because of the — 
peculiar way that computer media are currently evolving 


(--under large grants largely granted to professionals who 


use very large words to promote the idea that their origi- 
nal professions are largely applicable-- ), this sort of 
natural evolution may not take place. The new constructs 
of computer media, especially computer screen-media, may not 
have a chance to be thought out. We need designs for screen 
presentations and their mixture-- vignetting, Windows, 
screen mosaics, transformed and augmented views, and the 
rapid andcomprehensible control of these views and windows. 
We are still just beginning to find clever viewing tech- 
niques, and have hardly begun to discover highly respon- 
sive forms of viewability and control (cf. collateration 
in "Thinkertoys," p.}m52*%), and Knowlton's button-box (Fst) 
(See T. Nelson, "A Conceptual Framework for 
Man-Machine Everything," cited p. » and material on 
controls, below.) 


THE MIND'S UNIFICATION X 


One of the remarkable things about the human mind 
is the way it ties things together. Perceptual unity 
comes out of nowhere. A bunch of irregular resi- 
dential and industrial blocks becomes thought of as "my 
neighborhood." A most remarkable case of mental uni- 
fication is afforded by the visage of our good friend 
Mickey Mouse. The character is drawn in a most para- 
doxical fashion: two globelike protrusions (representing 
the ears) are in different positions on the head, depend- 
ing on whether we view him from the front or the side. 
No one finds this objectionable; few people even notice, 
it seems. 


THE PARADOXICAL ANATOMY OF MICKEY MOUSE 


POSSIBLE RECONCILIATIONS: Rolling 
Dtagonal Mounting Relative 
to Camera 


What this shows, of course, is the way the mind can 
unify into a consistent mental whole even things which 
are inconsistent by normal rules (in this case, the rules 
of three-dimensional structure). 


Even perceptions are subject to the same principle 
of unification. The fingernail is an excrescence with no 
nerves in it; yet somehow you can feel things with your 
fingernails-- tying together disparate sensations into 
a unified sense of something in the world (say, a coin 
you're trying to pick up). In the same way, an experienc- 
ed driver feels the road; in a very real sense, the car's 
wheels and suspension become his own sensory extensions. 


This principle of mental unification is what makes 
things come together, both literally and figuratively, 
in a fantic field. A viewer sees two consecutive movie 
shots of streets and unifies them into one street; controls, 
if you are used to them, become a single fused system of 
options; we can have a sense of a greater whole, of which 
one view on a screen is a part. 


TWE GESTALT, DEAR, BRUTUS 
1S NOT IN OUR_ STARS 


BOT IN OURSTWNES. 


CONTROLS: THEIR UNIFICATION AND FEEL 


Controls are intimately related to screen presenta- 
tion, just as arbitrary, and just as important. 


The artful design of control systems is a deeply 
misunderstood area, in no way deconfused by calling it 
"human factors." There are many functions to be control- 


-led, such as text editing operations, views of the uni- 


verse on a screen, the heading of a vehicle, the tilt of 
an aircraft, the windage and adjustments of artillery, 
the temperature of a stove burner and any other control- 
lable devices. And nowadays any conceivable devices 
could control them-- pushbuttons, knobs, cranks, wheels, 
levers and joysticks, trigger, dials, magic wands, mani- 
pulation by lightpen on CRT screens (see p.0™3'), flicks 
of the finger, the turning of the eyes (as in some ex- 
perimental gun-aiming devices), the human voice (but 
that introduces problems—- see p./MI3), keyboards, elec- 
tronic tablets, Engelbart mice and chordwriters, and so 
on. 


The human mind being as supple as it is, anything 
whatever can be used to control systems. The problem is 
having it be a comprehensible whole. 


As already remarked, our ability mentally to unify 
things is extraordinary. That we somehow tie together 
clutch, gear, accelerator and brake into a comprehensible 
control structure to make cars go and stop should amaze 
and instruct. 


Engineers and "human factors" people speak as though 
there were some kind of scientific or determinate way to 
design control systems. Piffle. We choose a set of con- 
trols, much like an artist's Palette, on the basis of ge- 
neral appropriateness; and then try best and most artistic- 
ally to fit them to what needs doing. 


The result must be conceptually clear and retroactive- 
ly “obvious"-- simply because clarity is the simplest way 
to keep the user from making mistakes. Clear and simple 
Systems are easier to learn, harder to forget, less likely 
to be screwed up by the user, and thus are more economic-— 
al-- getting more done for the resources put in. 


There is a sort of paradox here. The kinds of con- 
trols are totally arbitrary, but their unification in a 
good system is not. Smoothness and clarity can come from 
disparate elements. It is for this reason that I lay par- 
ticular stress on my JOT system for the input and revision 
of text, using a palette of keys available on the simplest 
standard computer terminal, the 33 Teletype. I cannot 
make the final judgement on how good this system is, but 
it pleases me. JOT is also an important example because 
it suggests that a conceptually unified system can be 
created from the artful non-obvious combination of loose 
elements originally having different intended purposes. 


Mental analogy is an important and clear control 
technique. We tend to forget that the steering wheel was 
invented, separately replacing both the boat's tiller and 
the automobile's tiller. We also forget that the use of 
such steering mechanisms must be actually learned by 
children. Such continuous analogies, though, require cor- 
responding continuities in the space to be controlled-- 
an important condition. 


Simplicity and clarity have nothing to do with the 
appearance of controls, but with the clarity and unique 
locatability of individual parts. For this reason I find 
deplorable the arrayed controls that are turning up, e.g. 
on today's audio equipment. Designers seem to think 
rows of things are desirable. On the contrary: the best 
designed controls I ever used are on the Sony TC-50 
pocket tape recorder : 


| 
t 
Fast! 
TAsT FORWAED 
'FoRw r % 
REVERSE Gaerwie. ii, 


but of course this is now phased out; instead most cassette 
recorders have five or six stupid buttons in a row. (Was 
it too good to last?) 


Spurious control elegance comes in many guises. Con- 
sider Bruce McCall's description of the Tap-A-Toe Futuroi- 
dic Footless De-Clutchingt™ system. This was offered on 
the fictitious 1934 Bulgemobiles, and allowed you to drive 
the car with one pedal, rather than three (see box nearby). 


Careless and horrible designs are not all fictitious. 
One egregious example also indicates the low level of de- 
sign currently going into some responding systems: comput- 
er people have designed CRT writing systems for newspapers 
which actually have a "kill" button on the console, by 
Which authors would accidentally kill their stories. In 
a recent magazine article it was explained that the event- 
ual solution was to change the program so that to kill 
the story you had to hit the "kill" button twice. To me 
this seems like a beautiful example of what happens when 
you let insulated technical people design the system for 
you: a "kill" button on the keyboard is about as intelli- 
gent as installing knives on the dashboard of a car, 
pointing at the passenger. 


There is another poor tendency. When computer pro- 
grammers or other technical people design particular 
systems without thinking more generally, things are not 
likely to be either simple or combinable. What may re- 
sult is intricate user-level controls for one particular 
function, controls that are differently used for another 
particular function, making the two functions not com- 
binable. 


What makes for the best control structures, then? 
There is no simple answer. I would say provisionally 
that it is a matter of unified and conspicuous constructs 
in the mental view of the domain to be controlled, 
corresponding to a well-distinguished and clearly-inter- 
related set of controlling mechanisms. But that is hardly 
the last word on the subject. 


THE ORGANIZATION OF WHOLENESS 


It should be plain that in responding screen- 
systems, "what happens on the screen" and "how the 
controls respond" are not really distinguishable. 
The screen events are part of the way the controls 
respond. The screen functions and control functions 
Merge psychologically. 


Now, there is a trap here. Just as the gas 
pedal, clutch, gearshift and brake merge psychologi- 
cally, any control structure can merge psychological- 
ly. Clutch and gear shift do not have, for most of us, 
clear psychological relevance to the problem of con- 
trolled forward motion. Yet we psychologically inte- 
grate the use of these mechanisms as a unified means 
for controlling forward motion (or, like the author, 
get an Automatic). In much the same way, any system 
of controls can gradually come through use to have a 
psychological organization, even spuriously. The trap 
is that we so easily lose sight of arbitrariness and 
even stupidity of design, and live with it when it 
could be so much better, because of this psychological 
melding. 
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But useful wholeness can be helped along. Just as 
what I have called the accordance-structure of writing 
(see "Writing," p.44Y3) moves it along smoothly, fantic 
design that builds from a well-organized internal dy- 
namic should confer on a fantic system the same momentum 
and clarity that carefully-organized writing has. 


This contribution of wholeness can only occur, how- 
ever, if the under-level complications of a system have 
been carefully streamlined and smoothed back, at least 
as they affect the user. Consider the design of the JOT 
text editing system (p.°S0) : while it is simple to the 
user, computer people often react to it with indignation 
and anger because it hides what are to them the signifi- 
cant features of computer text editing-- explicit pre- 
occupation with storage, especially the calling and re- 
vision of "blocks." Nevertheless, I say it is the de- 
tails at this level which must be smoothed back if we 
are to make systems for regular people. 


The same applies to the Th3 system (see p. DM&S ), 
which is designed to keep the user clear-minded as he 
compares things in multiple dimensions. The mechanisms 
at the computer level must be hidden to make this work. 


FANTIC SPACE 


Pudovkin and Eisenstein, great Russian movie-makers 
of the twenties, talked about “filmic space"-- the imagin- 
ary space that the action seems to be in. 


This concept extends itself naturally to fantic space, 
the space and relationships sensed by a viewer of: any me- 
dium, or a user in any presenting or responding environ- 
ment. The design of computer display systems, then, is 
really the artful crafting of fantic space. Technicalities 
are subservient to effects. (Indeed, I think computer 
graphics is really a branch of movie-making.) 


FANTIC STRUCTURE 


The fantic structure of anything, then, consists of 
its noticeable parts, interconnections, contents and ef- 
fects. 


I claim that it is the fantic unity-- the conceptual 
and presentational clarity of these things-- that makes 
fantic systems-- presentational systems and material-- 
clear and helpful, or not. 


Let us take an interesting example from a system for 
computer-assisted instruction now under implementation. 
I will not identify or comment on the system because per- 
haps I do not understand it sufficiently. Anyway, they 
have an array of student control-buttons that look like 
this: ° 


The general thinking in this system seems to be 
that the student may get an overall organizing view of 
what he is supposed to be learning (MAP); information on 
what he is currently supposed to be about (OBJ); canned 
suggestions based on what he's recently done (ADVICE). 
Morover, he can get the system to present a rule about 
the subject or give him practice; and for either of 
these he may request easier rules or practice, or harder 
rules (i.e., more abstruse generalities) or harder prac- 
tice. 


For the latter, the student is supposed to hit 
RULE or PRACT followed by HELP, HARDER or EASIER, viz.: 


Now regardless of whether this is a well-thoughfout 
way to divide up a subject— I'll be interested to see 
how it works out-- these controls do not seem to be well- 
arranged for conceptual clarity. It seems to be the old 
rows-of-buttons approach. 


I have no doubt that the people working on this sy- 
stem are certain this is the only possible layout. But 
consider that the student's options might be clearer to 
him, for instance, if we set it-up as follows: 


Generalities Approaches 


08 
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Or like this: 


Orientafhou 
Og 


Se arse 


EASTER | HARDER? HELP 


MAP 


ADVICE 


What I am trying to show here is that merely the 
arrangement of buttons creates different fantic con- 
structs. If you see this, you will recognize that 
considering all the other options we have, designing 
new media is no small matter. The control structures 
Merge mentally with the presentational structures. 

The temptation to settle on short-sighted designs hav- 
ing shallow unity is all too great. 


FANTIC DESIGN 


Fantic design is basically the planning and selec-. 
tion of effects. (We could also call these “performance 
values"-- cf. "production values" in movies.) 


Some of these intended effects are simply the com- 
munication of information or cognitive structure-- "in- 
formation transfer," to use one of the more obtuse 
phrases current. Other desirable effects include orien- 
ting the user and often moving him emotionally, including 


sometimes overwhelming or entrancing him. 


In the design of fantic systems involving automatic 
response, we have a vast choice among types of presenta- 
tional techniques, tricks that are just now becoming 
understood. Not just screen techniques and functions, 
but also response techniques and functions. 


(If '"feelie" systems are ever perfected, as in 
Huxley's Brave New World, it's still the same in prin- 
ciple. See Wachspress, p. DM4.) 


In both general areas, though-- within media, and 
designing media-- it seems to me that the creation of 
organizing constructs is the most profound problem. 

In particular, the organizing constructs must not dis- 
tract, or tear up contents. An analogy: in writing, the 
inventions of the paragraph, chapter and footnote were 
inventions in writing technique that helped clarify what 
was being expressed. What we need in computer~based 
fantic design is inventions which do not artificially 
chop up, constrain, or interfere with the subject (see 
box, Procrustes, nearby). 


I do not feel these principles are everywhere suf- 
ficiently appreciated. For instance, the built-in 
structures of PLATO (see '"Fantic Space of PLATO," p. 
9™2')) disturbs me somewhat in its arbitrariness-- and 
the way its control keys are scattered around. 


But there is always something artificial-- that is, 
some form of artifice-- in presentation. So the problem 
is to devise techniques which have elucidating value but 
do not cut connections or ties or other relationships 
you want to save. (For this reason I suggest the reader 
consider "Stretchtext," p. DM!) , collateral linkage 
(p- 5m 52), and the various hypergrams (p. hm \B- 14). 
These structures, while somewhat arbitrary and artifi- 
cial, nevertheless can be used to handle a subject 
gently.) 


An important kind of organizing construct is the 
Map or overall orienting diagram. This, too, is often 
partly "exact" and partly “artifice:" certain aspects of 
the diagram may have unclear import but clear and help- 
ful connotation. (For instance, consider the "picture 
systems" diagram on p. DM2O0 -—-- just what does the 
vertical dimension mean? Yes, but what does it really 
mean?) 


Responding systems now make it possible for such 
orienting structures to be multidimensional and respon- 
ding (cf. the orienting function of the "dimensional 
flip" control illustrated on p. DM®]  ). 


Fantic design, then, is the creation either of 
things to be shown (writing, movie~making, etc.) at the 
lower end, or media to show things in, or environments. 


1. The design of things to be shown-- whether 
writing, movie-making, or whatever-- is nearly always a 
combination of some kind of explicit structure-- an ex- 
planation or planned lesson, or plot of a novel-- and 
a feeling that the author can control in varying degrees. 
The two are deeply intertwined, however. . 


The author (designer, director, etc.) must think 
carefully about how to give organization to what.is 
being presented. This, too, has both aspects, cognition 
and feelings. 


At the cognitive end, the author must concern him- 
self with detailed exposition or argument, or, in fiction, 
plot. But simply putting appropriate parts together is 
not enough: the author must use organizing constructs to 
continually orient the reader's (or viewer's) mind. Re 
peated reference to main concepts, repeated shots (in a 
movie) of particular locations, serve this function; but 
each medium presents its own possible devices for this 
purpose. 


The organization of the feelings of the work 
criss-crosses the cognitive; but we can't get into 
it here. 
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Selection of points and parts contributes to both 
aspects. If you are trying to keep the feeling of a 
thing from being ponderous, you can never include 
everything you wanted, but must select from among the 
explicit points and feeling-generators that you have 
thought of. 


2. The design of media themselves, or of media 
subsystems, is not usually a matter of option. Books, 
movies, radio and TV are given. But on occasion, as 
for world's fairs or very personal projects, we have 
a certain option. Which allows things like: 


Smellavision or whatever they called it: 
movies with a smell-track, which went out 
into the theater through odor generators. 

Branching movies (see p.)m4')). 

"Multi-media" (multiple audio tracks and si- 
multaneous slide projections on different 
screens). 

Stereo movies. 


And so on. The thing about the ones mentioned is that 
they are not viable as continuing setups for repeated 
productions. They do not offer a permanent wide market; 
they are not stable; they do not catch on. Which is in 
a way, of course, too bad. 


But the great change is just about now. Current 
technicalities allow branching media-- especially those 
associated with computer screens. And it is up to us now 
to design them. 


3. MENTAL ENVIRONMENTS are working places for struc- 
tured activity. The same principles of showmanship apply 
to a working environment as to both the contents of media 
and the design of media. If media are environments into 
which packaged materials are brought, structured environ- 
ments are basically environments where you use non-packag- 
ed material, or create things yourself. They might also 
be called “contentless media." The principles of whole- 
ness in structured environments are the same as for the 
others, and many of our examples refer to them. 


The branching computer screen, together with the 
selfsame computer's ability to turn anything else on 
and off as selected by the user, and to fetch up in- 
formation, yields a realm of option in the design of 
media and environment that has never existed before. 
Media we design for screen-based computer systems are 
going to catch on widely, so we must be far more at- 
tentive to the options that exist in order to commit-- 
Nationally, perhaps-- to the best. 


In tomorrow's systems, properly unified controls 
can give us new flexibilities. If deeply well-designed, 
these promise magnificent new capabilities. For in- 
Stance, we could allow a musician to "conduct" the per- 
formance of his work by a computer-based music synthesis 
system (see “Audio,” p.}M!1), perhaps controlling the 
many qualities of the performance on a screen as he goes, 
by means of such techniques as dimensional flip (see 
p-dnm3)). (The tradition of cumulative audio synthesis, 
as practiced in the fifties by Les Paul and Mary Ford, 
and more recently by Walter Carlos and Mike Oldfield, 
will take on a new fillip as multidimensional control 
techniques become common.) 


One of the intents of this book has been to orient 
you to some of the possibilities and some of the options, 
considered generally. There is not room, unfortunately, 
to discuss more than one or two overall possibilities in 
detail. The most successful such system so far has been 
PLATO (discussed pp. DM18-19); others , 
Could uct be lisfed fey lace 
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NEW MEDIA TO LAST 


What ‘s worse, we are confronted not merely with the 
job of using computers to present specific things. The 
greater task is to design overall computer media that 
will last us into a more intelligent future. Adrift in 
a sea of ignorance and confusion, it is nevertheless our 
duty to try to create a whole transportation system that 
everybody can climb aboard. For the long run, fantic 
systems must be treated not as custom systems for explicit 
purposes, but as OVERALL GENERAL DESIGNS WHICH WILL HAVE 
TO TIE TOGETHER AND CATCH ON, otherwise collapse and 
perish. 


FINAL CONSEQUENCES. 


It seems to me certain that we are moving toward 
a generalized and universal Fantic system; people can 
and should demand it. Perhaps there will be several; 
but if so, being able to tie them together for smooth 
transmission is essential. (Think of what it would be 
like if there were two kinds of telephones?) This then 
is a great search, and crusade; to put together truly 
general media for, uture, systems at which we can read, 
write, learn and visualize, year after year after year. 
The initiatives are not likely to come from the more 
conventional computer people; some of them are part of 
the problem. (Be prepared for every possible form of 
aggressive defensiveness from programmers, especially: 
"Why would you want that?" The correct answer is 
BECAUSE, dammit!) 


But this all means that interior computer technical- 
ities have to be SUBSERVIENT, and the programmers cannot 
be allowed to dictate how it is to behave on the basis 
of the underlevel structures that are convenient to them. 
Quite the contrary: from the fullest consideration of the 
richest upper-level structures we want, we the users-to- 
be must dictate what lower-level structures are to be 
prepared within. 


But this means you, dear reader, must develop the 
fantic imagination. You must learn to visualize possible 
uses of computer screens, so you can get on down to the 
deeper level of how we are going to tie these things 
together. 


The designer of responding computer systems is 
creating unified setups for viewing and manipulating 
things-- and the feelings, impressions and sense of things 
that go with them. Our goal should-be nothing less than 
REPRESENTING THE TRUE CONTENT AND STRUCTURE OF HUMAN 
THOUGHT. (Yes, Dream Machines indeed.) But it should 
be something more: enabling the mind to weigh, pursue, 
synthesize and evaluate ideas for a better tomorrow. 

Or for any at all. 
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JcT: Juggler Of Text. 


CREATING TEXT: just type it in. 


Yoo Hype: i sp sp sp sp 


 Jopes: (bell) The quick brown fox 


You Vypes. sp ! sp ! sp 1 fox 


i? Apes: The ! quick ! lithe ! fox 


CHECK THE RESULTS: 


é sp sp “sp sp 
(bell) The lithe quick fox 


TO REARRANGE IT, YOU TYPE: LINE FEED key. 


From "A Human Beng’ Iktroduclion “fo the JOT System." ©1972 T. Nelson. 


Here's how simple it is to create and edit text with the JOT system. 
Since your typewriter is now a JOT machine, not every key does what it used to 


Yor Yipes The quick brown fox jumps over the lazy dog. 


TP hi per: The quick brown fox jumps over the lazy dog. 


REVIEWING A SENTENCE YOU JUST TYPED: the back-arrow takes you back, the space bar steps you 


through. 


DELETIONS AND INSERTIONS: the RUBOUT key rejects words you don't want. To insert , merely type. 
Yer ‘Seo = sp sp RUBOUT lithe sp_ sp sp sp. sp sp 
x Types (bell) The quick /brown/ lithe fox jumps over the lazy dog. 


REARRANGING TEXT: first we make three Cuts in the text, signalled by free-standing exclamation 


points. 


This exchanges the two pieces between the cuts. 
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«THINKER TOY S* 


Our greatest proplems involve thinking and the 
visualization of complexity. 


By "Thinkertoy" I mean, first of all, a system 
to help people think. ('Toy' means it should be easy 
and fun to use.) This is the same general idea for 
which Engelbart, for instance, uses the term "aug- 
mentation of intellect." 


But a Thinkertoy is something quite specific: 
I define it as a computer display system that helps 
you envision complex alternatives. 


The process of envisioning complex alternatives 
is by no means the only important form of human 
thought; but it is essential to making decisions, de- 
signing, planning, writing, weighing alternate theor- 
ies, considering alternate forms of legislation, doing 
scholarly research, and so on. It is also complicated 
enough that, in solving it, we may solve simpler prob- 
lems as well. 


We will stress here some of the uses of these sy- 
stems for handling text, partly because I think these 
are rather interesting, and partly because the com- 
plexity and subtlety of this problem has got to be 
better understood: the written word is nothing less 
than the tracks left by the mind, and so we are really 
talking about screen systems for handling ideas, in 
all their complexity. 


Numerous types of complex things have to be inter- 
compared, and their relations inter-comprehended. Here 
are a few of the many types: 


Alternative designs. 


a 


Discrepancies among the testimony of witnesses. 


Successive drafts of the same document. 


Pairs of things which have some parts the 
same, some parts different (contracts, holy books, 
statutes of different states, draft versions of 
legislation...) 


a 
Different theories and their ties to parti- 
cular examples and evidences. 


few} au, 


= ee 


Under examination these different types of inter- 
comparison seem to be rather different. Now, one ap- 
proach would be to create a different data structure 
and viewing technique for each different type of complex. 
There may be reasons for doing that in the future. 


For the present, however, it makes sense to try to 
find the most general possible viewing technique: one 
that will allow complex intercomparisons of all the 
types mentioned, and any others we might run across. 


One such.technique is what I now call collatera- 
tion, or the linking of materials into collateral struc- 
tures *as will be explained. This is fairly straight- 
forward if you think enough about the problem; Engel- 
bart discovered it independently. 


Let us call two structures collateral if there are 
links between them, connecting a selected part of one 
with a selected part of the other. The sequences of 
the connected parts may be different. For simplicity's 
sake, suppose each. one is a short piece of writing. 

(We will also assume that there is some convenient form 

of rapid viewing and following between one end of a link 

and another.) 
FrRsy YOCcumENy 
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We might also think of them as systems for 


THE MANAGEMENT OF LOOSE ELS. 


tec 


Now, it will be noted first off that this is an ex- 
tremely general method. By collateral structuring we 
can easily handle the equivalents of: tables of contents; 
indexes; comments and marginalia;. explanations, exegesis, 
explication; labeling; headings; footnotes; notes by the 
writer to himself; comments and questions by the reader 
for later reference; and additional details out of se- 
quence. 


Collateration, then, is the creation of such 
multiple and viewable links BETWEEN ANY TWO DATA 
STRUCTURES, in principle. It is general and powerful 
enough to handle a great variety of possible uses in 
human intellectual endeavor, and deserves considerr 
able attention from researchers of every stripe.** 


The problem then, is how to handle this for 
rapid and convenient viewing and whatever other work 
the user wants to do-- writing and splicing, inter- 
comparing, annotating and so on. Two solutions ap- 
pear on this spread: The Parallel Textface~, design- 
ed as a seminal part of the Xanadu system (see p.\5é6), 
which I hope will be marketed with that system in the 
near future, and a more recent design which I've work- 
ed on at the University of Illinois, the 3D Thinkertoy 
or Th3. 


CLARITY AND POWER 


We stressed on the other side of the book that 
computer systems must be clear, simple and easy to use. 
Where things like business uses of computers are con- 
cerned, which are intrinsically so simple in principle, 
some of the complications that people have been forced 
to deal with in ill-designed computer systems verge on 
the criminal. (But some computer people want others 
to think that's the way it has to be. "Your first 
duty is to keep your job, right?" one computer person 
said to me recently. “It wouldn't do to set up systems 
so easy to use that the company wouldn't need you any- 
more." See "Cybercrud," p.8.) 


But if it is desirable that computer systems for 
simple-minded purposes be easy to use, it is absolutely 
necessary that computer systems for complicated purposes 
be simple to use. If you art wrangling over complex al- 
ternatives-- say, in chess, or in a political simula- 
tion game (see “Simulation," p. Ss ), or in the throes 


of trying to write a novel, the last thing you will tole- 


rate is for your computer screen to introduce complica- 
tions of its own. If a system for thinking doesn't 

make thinking simpler-- allowing you to see farther and 
more deeply-- it is uselss, to use only the polite term. 


But systems can be both powerful and simple at 
the same time. The myth that things have to be com- 
plicated to do anything for you is pernicious rubbish. 
Well-designed systems can make our mental tasks lighter 
and our achievements come faster. 


It is for this reason that I commend the reader 
these two designs of mine: as examples of user-level 
control and viewing designs-- fantic environments, if 
you will (see p?"g-5))-- that are pruned and tuned to 
give the user great control over the viewing and cross- 
consideration of intricate alternatives, without com- 
plication. I like to believe that both of these, in- 
deed, are ten-minute systems-- that is, when we get 
them running, the range of uses shown here can be taught 
to naive users;in ten minutes or less. 


It is because of my heartfelt belief in this kind 
of simplicity that I stress the creation of prefabrica- 
ted environments, carefully tuned for easy use, rather 
than the creation of computer languages which must be 
learnt by the user, as do such people as Engelbart (see 
p-bAYG) and DeFanti (see p.)m31). Now, their approach 
fbviously has considerable merit for sophisticated users 
who want to tinker repeatedly with variant approaches. 
For people who want to work incessantly in an environ- 
ment, and on other things-- say writers-- and are ab- 
sent-minded and clumsy and nervous and forgetful (like 
the present author), then the safe, prefabricated en- 
vironment, with thoroughly fail-safe functions and ut- 
terly memorable structural and control interrelation- 
ships, is the only approach. 


* in my 1965 paper (see bibliography) I called collateral 


structures zippered lists. 


4 A group at Brown University has reportedly worked 
along these lines since I worked with them, but due 
to certain personal animosities I have not kept up 
with their developments. It will be interesting to 
see what kind of response they can get out of the 
IBM systems they are using. 
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DECISION/CREATIVITY SYSTEMS 
[HteRroes] 


Theodor H. Nelson 
19 July 1970 


It has been recognized from the dawn of computer display that the 
grandest and most important use of the computer display should be to 
aid decisions and creative thought. The work of Ivan Sutherland (SKETCHPAD) 
and Douglas Engelbart have really shown how we may use the display to 
visualize and effect our creative decisions swiftly and vividly. 


For some reason, however, the most important aspect of such systems 


has been neglected. 


We do not make important decisions, we should not 


make delicate decisions, serially and irreversibly. Rather, the power of 
the computer display (and its computing and filing support) must be so 
crafted that we may develcp alternatives, spin out their complications 
and interrelationships, and visualize these upon a screen. 


WE OFTEN WANT TO SAVE ALTERNATIVES. 


28 


side 

And closely to my Sone, she press'd, 
And closer still with 

[And ask'd me with ber swimming eyes] 


might 
That I [would | rather feel than see 
Theswellingefher Heart 
(Her gentle Bosom rise.—] 
29 


[And now serene, serene & chaste,| 1 calm'd her fear; & she was calm 
(But seon in calm and solemn tone} 


And 
[Se] told ber love with maiden pride ; 
And so I won my Genevieve, 


dear 
My [bright] & lovely Bride.) 


following: 


From Coleridge's Poems: A Facsimile 


Reproduction of the Proofs 
and MSS. of some of the Poems. 


(Folcroft, 1972.) 


No system could do this for us automatically. What design and 
programming can create, however, is a facility that will allow us 
to list, sketch, link and annotete the complexities we seek to under 
asbful art, stand, then present "views" of the complexities in many different forms. 
Studying these views, annotating and refining, we can reach the final 
designs and decisions with much more in mind than we could otherwise 
hold together in the imagination. 


Some of the facilities that such systems must have include the 


Annotations to anything, to any remove. 
Alternatives of decision, design, writing, theory. 
Unlinked or irresular pieces, hanging as the user wishes. 


Multicouvling, or complex linkage, between alternatives, annota- 
tions or whatever. 


Historical filing of the user's actions, including each addition 
and modification, and possibly the viewing actions that preceded them. 


Frozen moments and versions, which the user may hold as memorable 


for his thinking. 


Evolutionary coupling, where the correspondences between evolving 
versions are automatically maintained, and their differences or relations 


easily annotated. 


In addition, designs for screen "views", the motion, appearance 
and disappearance of elements, require considerable thought and imagi- 


nation. 


The object is not to burden the user, or make him aware of complex- 
ities in which he has no interest. But almost everyone in intellectual 
and decision pursuits has at some time an implicit need for some of 


these facilities. 


If people knew they were possible, they would demand 


them, It is time for their creation. 


A full-fledged decision/creativity system, embracing both text and 
graphics, is one of the ultimate design goals of Project XANADU. 
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The PAPALLEL Texrrace™ i 


This user-level system is intended to aid in 
all forms of writing and scholarship, as well as 
anywhere else that we need to understand and mani- 
pulate complex clusterings of text (i.e., thought). 
It will also work with certain animated graphics. 
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inkependent fext dependent > ther} 


DERIVATIVE MOTION: when links run sequential- 
ly, connecting one-after-the-other on both sides, 
the contents of the second panel are pulled along 
directly: the smooth motion in one panel is match- 
ed in. the other. This may be called derivative 
motion, between independent text (being handled 
directly with the lightpen) and dependent text 
(being pulled along). The relationship may be re- 
versed immediately, however, simply by moving the 
lightpen to the control pip of the other panel, 
whose contents then become the independent text. 


_ The Parallel Textface, as described here, 
furnished the initial impetus for the development 
of the Xanadut™ system (see p.>mMS@)-. Xanadu was 
developed, indeed, originally for the purpose of 
implementing some of these functions, but the two 
split apart. It turned out that the Parallel 
Textface required an extremely unusual data struc- 
structure and program techniques; these then became 
the Xanadu system. As developed in the final 
Xanadu design, they turn out to handle some very Real person sits at ree . : > 
unusual kinds of screen animation and file retrieval. cardboard Xanadu mockup. ; Irregularities in the links will cause the 
But this grew out of structuring a system to handle independent text to move at varying speeds or jump, 
the functions described here. according to an average of the links' connectivity. 


Thus the Parallel Textface basically requires 
a Xanadu system. 


It is hoped that this system can be sold com- 
plete (including minicomputer or microprocessor-- 
no connection to a large computer is required) for 
a few thousand dollars by 1976 or 1977. See p. 
(Since "business people" are extremely skeptical 
as to whether anybody would want such a thing, I 
would be interested in hearing expressions of in- 
terest, if any.) 
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Collateral links between materials in the 
two panels are displayed as movable lines bet- 


Sn Meera OE 


is ne ce a tr Two panels are about ween the panels. (Text omitted in this diagram; 
@ Wwe T: NELSon oe te a 10 x 10 panel boundary has been made to appear.) 
A Some links may not have both their endpoints 
s shown here, the screen presents two panels displayed at once. In this case we show the in- 
of text; more are allowed. Each contains a seg- complete link as a broken arrow, pointing in the 
ment of a longer document. ("Page" would be an im- direction of the link's completion. 
proper term, since the boundary of the text viewed 
may be changed instantly.) 
= 
The other odds and ends on the screen are hid- = 
den keys to control elements which have been made = 
to fade (in this illustration), just to lessen the eas 
distraction. = 
Panel boundaries and control graphics may b2 | a 
made to appear by touching them wih The light pew. ——— 
Independent text pulls 
dependent text along. QM T Neries 
Painted streaks simulate 
motion, not icicles. The broken arrow serves not merely as a vi- 
sual pointer, but as a jump-marker leading to the 
linked material. By zapping the broken arrow with 
the lightpen, the user summons the linked material-- 
as shown by the completion of the link to the other 
panel. (Since there has been a jump in the second 
panel, we see that in this case the other link has 
been broken.) 
Git7z T.Nerson 
ROVING FUNCTIONS 4s 
= 
The text moves on the screen! (Essential.) aa 
The lower right hand corner of each text panel | 
contains an inconspicuous control diagram. The Seca 
slight horizontal extension is a movable control : 
pip. The user, with his light pen, may move the 
pip up or down. "Up"causes the text to move Saaee 
Sarnia upward eg Rie in the material), at a 
rate proportional to how far you push the pip; 
Be ar erie it to move nick (Note Gialewe’ Bo poy ca 
not refer here to jerky line-by-line jumps i 
to smooth screen mnevan ictiois saeantinl fe Ce i ee 
a hagh peetovesce Sisteec. TE tke test floes not of these destinations may nevertheless be seen at 
aivk 900) Sent rae were Le cans tea) once. This is. done by pointing at both broken links 
in succession; the system then allows both links to 


be completed, breaking the second panel between the 
two destinations (as shown by dotted line across 
panel). 


OL 
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FAIL-SAFE AND HISTORICAL FEATURES. 


In systems for naive users, it is essential 
to safeguard the user from his own mistakes. Thus 
in text systems, commands given in error must be 
reversible. For instance, Carmody's system (see 
p. DM} 7 ) requires confirmation of deletions. 


Another highly desirable feature would allow 
the user to view previous versions, to see them col- 
laterally with the corresponding parts of current 
versions, and even go hack to the way particular 
things were and resume work from the previous 
version. 


In the Parallel Textface this is all com- 
prised in the same extremely simple facility. (Ex- 
tremely simple from the user's point of view, that 
is. Inside it is, of course, hairy.) 


In an egregious touch of narcissistic humor, 
we use the very trademark on the screen as a control 
device (expanded from the "X" shown in the first 
panel \ 


\ Vn 
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Actually the X in "Xanadut™," as it appears 
on the screen, is an hourglass, with a softly fall- 
ing trickle of animated dots in the lower half, and 
Sands of Time seen as heaps above and below. These 
have a control, as well as a representative, func- 
tion. 


TO UNDO SOMETHING, YOU MERELY STEP "BACKWARD 
IN TIME" by dagging the upper part of the hourglass 
with the lightpen. One poke, one editing operation 
undone. Two pokes, two operations. 


You may then continue to view and make changes 
‘as if the last two operations had never taken place. 
This effectively creates an alternative time-line.* 
However, if you decide that a previously undone edit 
operation should be kept after all, you may step 
forward-- stepping onto the previous time-line-- 
by using the lower half of the hourglass. 
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We see this clarified in a master time diagram 
or Revision Tree which may be summoned to the screen, 
never mind how. In this example we see that three 
versions are still "current," various other starts 
and variations having been abandoned. (The shaggy 
fronds correspond to short-lived variations, result- 
ing from operations which were then reversed. In 
other words, "excised" time-lines, to use Gerrold's 
term-- see footnote.) 
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The user-- let's say he is a thoughtful writer-- 
may define various Versions or Drafts, here marked 
on the Revision Tree. 
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He may, indeed, define collateral linkages between 


different versions defined at various Times in the 
Tree... 


DKAET | 
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--- and see them displayed collaterally; and revise 
them further. 
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Materials may be copied between versions. (Note 
that in the copying operation of the Parallel Text- 
face, you actually see the moved text moved bodily 
as’ a block.) 


GETTING AROUND 

The user may have a number of standby layouts, 
with different numbers of panels, and jump among 
them by stabs of the lightpen. 


Importantly, the panels of each can be full, 
per having whatever the contents were when you last 
left it. 
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The File Web'™ is a map indicating what 
(labelled) files are present in the system, and 
which are collaterated. 


1 why eduction, 
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The File Star™™ is a quick index into the con- 
tents of a file. It expands as long as you hold 
the lightpen to the dot in the center, with various 
levels of headings appearing as it expands. Natur- 
ally, you may jump to what you point at. 
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EDITING 


Rather than giving the user any thing complicat- 
ed to learn, the system is completely. visual. All 
edit controls are comprised in this diagram, 
Roset™, Viz.: 


the Edit 


Insert 
Delete 


V 
x 

ed Rearvange 
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Operation apples te Link 


| Operation appbes te file 
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Separate portions of the Edit Rose invoke 
various edit operations. (You must also point with 
the lightpen to the necessary points in the text: 
once for insert, twice for Delete, three or four 
times for Rearrange, three times for Corv ) 
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GENERALITY. 


The system may be used for comments on things, 
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for organizing by multiple outlines or tables 
of contents; 
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and as a Thinkertoy, organizing complex alternatives. 
(The labels say: "Conflicting versions," "New account 
of conflicts," "Exposition of how different accounts 
deal with objections," "Improved, synthesizing account." 


In other words, in this approach we annotate and 
label discrepancies, and verbally comment on differen- 
cesin separate files or documents. 


In ways this may seem somewhat obtuse. Yet above 
all it is orderly, and the complex of collateral files 
has a clarity that could be all-too-easily lost in sy- 
stems which were programmed more specifically to each 
problem. PEG wens oe 
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The fundamental strength of collateration, 
seen here, is of course that any new structure 
collateral to another may be used as a table of 
contents or an outline, taking the user instantly 
to parts which are of interest in some new context. 


* Oddly, this has the same logical structure as 
time-travel in science-fiction. 


There are basically three alternate premises of 
of time-travel: 1) that the past cannot be changed, 
all events having preceded the backstep; 2) that the 
past can be changed; and 3) that while time-travelers 
may be deluded into thinking (2), that (1) is really 


' the case-- leading to various appointment-in-Samarra 


plots. 


Only possibility (2) is of interest here, but 
there are various alternative logics of mutability and 
time-line stepping. One of the best I have seen is in 
The Man Who Folded Himself by David Gerrold (Popular 
Tibrary, 1973): logic expounded pp. 64-8. I am be- 
mused by the parallel between Gerrold's time-controls 
and these, worked out independently. 


® VEKY ADVANCED (?) 
TEXT SYSTEM. 


Read this at your peril. 
ge ee il 
Coneept- freaks only. 


This design, Th3 (Thinkertoy in 
3 dimensions), is one I have been work- 
ing at while on the faculty of the Univ- 
ersity of Illinois. It is designed spe- 
cifically for implementation using De- 
Fanti's GRASS language (see p.5”™ 31), 
and the Vector General 3D display (see 
p-"§o). Whether it will ever be actually 
programmed depends, of course, on numer-— 
ous factors. 


It is meant to be a very high- 
power thinkertoy, suitable for experimen- 
tation with creative processes, especially 
writing and three-dimensional design. 
(There is no room to discuss the latter 
here.) It is suited¢tspecially to the visual- 
ization of tentative structures in amorphous 
clusters. In some of its features it goes 
considerably beyond the more "commercial" 
thinkertoy system, the Parallel Textface 
(elsewhere in this spread). 


Nevertheless, the same design criteria 
apply: a well-designed computer environment 
for any purpose should be learnable in ten 
minutes; otherwise the designer has not been 
doing his job. (I mean it would be learnable 
in ten minutes if you and I had it in front 
of us, working. This description will have 
to be weird and abstruse, I'm sorry to say.) 


This system is designed around a three- 
dimensional display screen (the Vector Gener- 
al display, as manipulable by th@GRASs lan- 
guage). 


Now, most people do not think of text 
as three-dimensional. Laymen think of it as 
two-dimensional, since it's usually printed 
on rectangular pages. Computer people or- 
dinarily think of it as one-dimensional, as 
a long string of characters and spaces-—- 
essentially what you'd get if you printed 
things in one line on a long, long ribbon. 
Well, frankly, I don't think of text as 
three-dimensional either; but like anything 
else, it has numerous qualities or dimen- 
sions, any three of which it's nice to be 
able to view at once (see "Dimensional Flip,") 
p-dWSi). And that's essentially the idea: 
the three dimensions we'll look at at any 
one time will be a particular view of a larger 
whole. 


Now, the basic torm of storage will be 
one of those Nelson-structures that drives 
computer people batty. Specifically, the 
basic data structure will be clusters of 


points. 


Puns sometimes reflect a higher reality. 
Now it turns out that this structure in fact 
reflects a great Folk Truth: written discourse 
intend to get across. That we here intend to 
have them rotate as dots upon a screen reflects 
this structure. 


Writing is, in fact, a projection from 
the intended "points" to a finished exposition 
which embraces them. Now, this is very like 
the view of language held in modern linguistics, 
namely, that a finished sentence is a "surface 
structure" constructed out of basic sentence 
kernels chewed up by certain transformations. 
Well, I am just pointing out here that writing 
is a surface structure of "points" which have 
been embedded and spliced in a structure of 
transitions, accordance-notes and so forth (see 


p. SMYS )* 


The general idea of the Th3 system, then, 
is that the user may view the "points" he 
wishes to make, variously upon the 3D viewing 
surface. Successive drafts, then, will all be 
projections, geometrically, from this interior 
structure of points. 


Finally, the unifying idea that gives the 
system simplicity is this: all views will be on 
faces of a cube. 


(FURTHER TECHNICALITIES OF THESE ‘POINTS': 
Each point may have a value (numerical pa- 
rameter) in any of a number of dimensions 
(which number may itself change). Such 
values may be null, as distinct from zero, 
showing that the point has no position on 
that particular scale. 

Associated with each point may be one 
or more pieces and scraps or written mater- 
ial. Such scraps may be just phrases or 
single words. (Indeed, such scraps may be 
associated not just with a point, but with 
several specific values of a point.) Each 
scrap may also contain keywords. 

Discrete relations between points may 
also be defined. There may be a variety 
of types of relation, which either exist 
between two points of don't.) 


The crucial point here is that it's unified 
to the user: every version appears on a side of 
a box; and a typeset version is simply a magni- 
fied two-dimensional view in which the two dimen- 
sions are "position in overall text" (vertical) 
and "position on line" (horizontal). 


Each side of a box may have a different 
view projected to it. This means that as many 
as three views of a specific cluster may be 
seen at once. However, for consistency these 


must have appropriately common dimensions. 
OR pf 


POS Troy 


Recency (POR TANCE 

By rotation and zooming the user may focus 
on the original pieces, and work with them, writ- 
ing and revising. 


Moreover, by using a combination of zoom 
and hardware clipping (as available on this 
equipment), the user may restrict his work to 
a specific range of material on particular di- 
mensions. 


GALAXY AND BOX 


There are basically two views of what 
you are working with: the Galaxy and the Box. 
They appear in various manifestations, allow- 
ing you to study discrete relations and struc- 
tures in the material; various "dimensions" of 
the material; alternate versions and drafts to 
be made from the material; and the complex col- 
lateration (see under "Thinkertoys") of differ- 
ent structures. 


In what follows we will discuss the screen 
functions but not the control structures, which 
have not firmed up particularly. 


1. GALAXY VIEWS. 


The points are seen as a cloud of dots on 
the screen. If no view coordinates are supplied, 
the dots will be randomly positioned. 


A. "Star Trek" effect. 
Under a user's zoom control, the dots 
fly apart as if he is hurtling through 
space. 


B. MAGNIFICATION. The user may "magnify" 
the dots, making each show its keywords, 
further text, and on up tothe full 
Piece. 


C. ROTATION. The 3D structure of the dots 
in space may be seen by the user at 
any time through short rotations. 


D. Any relations that exist among the 
Points, insofar as they have been logg- 
ed into the system, may be displayed 
amens the pots: 

E. The user may sort the points by moving 
them with a lightpen. 


F. The user may write within the individ- 
ual pieces and splice them together, 
combining lightpen and keyboard oper- 
ations. 


2. BOX VIEWS 


In the Galaxy Views, the individual Points 
simply swarm about with no definable position. 
“Box Views" allow you to order the points on any 
dimensions that have meaning to you, in an ar- 
bitrary coordinate-space. 


The box is more than a mere measurement= 
frame. On request the user may see the points 
projected on a specific face of the box (ortho- 
graphically); and on request he may also see pro- 
jection lines between a box-face and its cor- 
responding point in the point cluster. 
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"Magnifying,’ as before, will create a view 
of the text: but in the box mode of viewing, the 
text appears on the side of the box. That is, 
the inner view will project to the outside, 
yielding a draft. Naturally, this is the current 
assembly of your pieces; if certain coordinates 


are selected it is even a "typeset" version. 


Who, hello There, 
she said yarns 


(Note: Vector General hardware does not al- 
low character rotation; only keyword and headline 
rotation is possible, through software character 
generation. Thus text pieces on the side of a 
box show certain freaky movements if the side is 
not viewed square-on.) 


Fat the 1971 Spring Joint Computer Conference, I think it was, 

‘I was heckled by a linguist who accused me of being “unimaginative," 
insisting further that writing is merely an extension of speech 
and thus "merely" the application of further transformations; and 
he claimed further that what the user therefore needs is an input 
language to specify these transformations. This view, while inter- 
esting, is wrong. 

A but/indeed control language might be interesting, however. 

—_VS"= 


[Appended by the 
however-operation, a postfix "but." See "Writing," p. DM43.] 
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COLLATERAL GALAXIES AND BOXES. 


Viewing of collateral structures works 
through the same mechanism. Galaxies and 
boxes may be collaterated: 


COMPLICATED NOTE: The extension of these 
mechanisms to pictorial graphics in two 
and three dimensions is straightforward, 
and to conceptual substructures (such as 
may exist) behind these graphics. The 
same goes for collateration and annotation 
of multidimensional cluster materials, e.g. 
in sociology: the system would allow, for 
instance, the viewing, annotation and col- 
lateration of sociometric clusterings.) 


BOX FISSION. (The Beauty Part.) 


For paired views of projections from 
the same cluster which do not share a com- 
mon coordinate, a marvelous trick is pos- 
sible: BOX FISSION. Starting with one box 
containing a galaxy, we pull it apart, 
making two boxes and two galaxies whose 
Points are linked. 


Fisoon 


INDEPENDENTLY reoTAMELE 
COLLATERATED Roxes, 


aN 
es 


Now both boxes can be rotated indepen- 
dently, and any view considered; equivalence- 
linkages may now be viewed between any two 
views. (The eye must, however, turn two 
corners.) 


Co RESPON DINE 


(It is interesting to note tnat the links in 
Box Fission are handled automatically, to an 
extent, by the hardware.) 


WELCOME TO THE FUTURE. HUH? 


This has summarized the development of 
some ideas for the viewing and manipulation 
of complex stuff. I offer this design, inso- 
far as I have been able to present it here, 
as an example of fantic design (see p. So yi 
There is,no logical necessity to it; it cor- 
responds to the traditional structure of no 
technical system; it arises from no intrinsic 
or traditional data structures used for com- 
puter representation of these things. 


But none of these considerations is to 
the point. This design has a certain stark 
logical simplicity; it extends itself plaus- 
ibly from its basic outlook (or starting 
ideas, if you can isolate them) into a tool 
for truly intricate cross-consideration, 
without adding unnecessary and hard-to- 
remember "technicalities." At least that's 
how I think of it. 


Obviously the aesthetics of it are im- = 
portant to the designer. But a more final 
criterion of its goodness-—- its usefulness-- 


‘may depend on the same parsimony and organi- 


zational clarity. 
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&) Xanadu, friend, is my dream. 
The name comes from the poem (nearby) ; 
Coleridge's little story of the artistic trance 
(and the Person from Porlock) make it an appro- 


priate name for the Pleasure Dome of the crea- 
(prenous ced Zamna ~Doo) tive writer. The Citizen Kane connotations, 
and any other connotations you may find in the 
poem, are side benefits. 


I have been working on Xanadu, under this 


KUBLA KHAW ; GR: A VISION IN A DREAM and other names, for fourteen years now. 


A FRAGMENT. Originally it was going to be a super sys- 
Is the summer of the year 1797, the Author, then in ill health, had tem for handling text by computer (see p. | 
retired to a lonely farm house between Porlock and Linton, on the > 7 4 
Exmoor confines of Somerset and Devonshire. In consequence of a and | D ) - But it grew >: as I reali zed ’ level 
slight indisposition, an anodyne had been prescribed, from the effect 
of which he fell asleep in his chair at tlfe moment that he was reading by level > how de ep the p rob ed em was, 
the following sentence, or words of the same substance, in ‘* Purchase’s 
he gerne ee i - — pits ae a@ palace to be 
uilt, and a stately garden thereunto: and thus ten f fertil - 
ground were inclosed with a wall. The Author eantinued for about = Eee And th e conc ep t of wh at it was to b e k ep t 
tated ghee Pte at — of = rf Saplanoe! — during which h . I d 1 1 h 
e has the most vivid confidence, that he could not have d 
os ec eraaige ee = ony hundred lines ; ph we indeed can be called © ang - se id as oe = re ae Beth. HARE Ms t # t 
mposition in which all the images rose up ore him asthings, with 
—-* Production of - Fee peng expressions, without an it had to be Re mens . ouput . "A for the * home % 
ation or consciousness of effort. On awaking he appeared to himself 
Poi a ons es ga soit of the hg eae _ faking his pen, ink, and (Y ou fan have — =  Shalade! e it ce too s+ f Y - 
paper, instantly‘and eagerly wrote down the lines that are here pre- i 
served. At this moment be ce unfortunately called out i a parece Ww ant 9 bu t th at s no t wh at 1 t s ab ou t 3 ) 


on business from Porlock, and detained by him above an hour, and on 
fa Mo eee oo —n ——— to his no small ——— toner aig an 

tat though he still retained some vague and dim recollection of the 1 1 1 ° 
general purport of the vision, yet. with the exception of some eight or Now the 1 de a 1s th 1S; 
ten scattered lines and images, all the rest had passed away like the 
images on the surface of a stream into which a stone had ton cast, 
but alas ! without the after restoration of the latter : 


To give you a screen in your home from 


Ip brokenall that phantom-World 0 fai, which you can see into the world's hypertext 
And each mis-shape the other. ‘Stay awhile, libraries. 


Poor youth! who scarcely dar'st lift up thine eyes— 
The stream will soon renew its smoothness, soon 


ed soon the fragments dim of lovely forks (The fact that the world doesn't have 

‘ome tremblin, c " . ° = —_— 

The pool becomesa mirror. ee MOF any hypertext libraries-- yet-- is a minor 

As a contrast to this vision, I have annexed a fragment of avery dif. poin t. ) 
ferent ce describing with equal fidelity the dream of pain and 
KUBLA KHAN. To give you a screen system that will 

1s Masia eu eee offer high-performance computer graphics: and 
A stately pleasure-dome decree : *text services at a price anyone can afford. 
Miners Alpb, the sacred river, ran To allow you to send and receive written mes- 
hrough caverns measureless to man 4 
5 qoown to a sunless sea. Sages at the Engelbart level (see p.-DM46). To 
0 twice five miles of fertile ground i 
With walls and towers were girdled round : allow you to wi : = di grams (s oa-Y : DM i and 
And there were gardens bright with sinuous rills P. DMS1 ). To eliminate the absurd distinction 


Where blossomed many an incense-bearing tree : 
And here were forests ancient as the hills, 
Enfolding sunny spots of greenery. 
But oh ! that deep romantic chasm which slanted 
Down the tong hill athwart a cedarn cover ! 

Pp 


between ''teacher" and "pupil." 


To make you a part of a new electronic 


Se oe ee ee es P literature and art, where you can get all your 
Ss eer neath a waning moon was aunte: . ° 
By woman wailing for her demon lover ! questions answered and nobody will put you 


And from this chasm, with ceaseless turmoil seething, down * 
As if this earth in fast thick p ants were breathing, 

A mighty fountain momently was forced : 

Amid whose swift half-intermitted burst Ce ee 
Huge fragments vaulted like rebounding hail, 

Or chaffy grain beneath the thresher’s flail : 


And ’mid these dancing rocks at once and ever ses 
It flung up momently the sacred river. Originally Xanadu was programmed around 
— —_ ce yercins: = = seeny action the Parallel Textface (see p. DM53). But as 
Tou Wo an aie the sacred river ran, . 
Then reached the caverns measureless to man, the requirements of the Parallel Textface were 
And sank in tumult to a lifeless ocean : better and better understood, Xanadu became 
And ‘mid this tumult Kubla heard from far + tyi t e 414-2 
Ancestral voices prophesying war ! a more general underlying system for a Orms 
aoe abate of the dome of Bieeeure of interactive graphic environments. Its data 
Floated mid-way on the waves ; = 3 
oo was heard the mingled measure structure has Virtual Blocklessness and is 
rom the fountain and the caves. 1 
He Wake wirhcle Bf rare devise, thus well related to the smooth motions needed 
A sunny pleasure-dome with caves of ice ! by screen users. Thus in its final form, now 
then Sige pone being debugged, it will support not. only the 
na vision once I saw : + 
It was an Abyssinian maid, Parallel Textface (see Be 5 ), the Walking Net 
iadas his Gisetenet she played, (see p. DNS] ), Stretchtext (see p. DMI9), Zoom 
inging of Mount Abora. ° 9 .. 9 
Eerevugueny toes Maps (see p. )DM1I9) and so on, but indeed any 
: To such a deep delight ‘twould win me data structure that needs to combine complex 
hat with music loud and long, * * 4 = 
I would build that dome in air linkages with fast access and rapid changes. 
That sunny dome ! those caves of ice ! Because the data structure is recursivel 
And all who heard should see them there, t ibl it ill ermit h ertext (s ee DM 44) 
And all should cry, Beware ! Beware! extensl e€, 1 Wl Pp Z yp p- 
His Sesitog a ee Coeena bar! of any depth and complexity, and the collateral 
eave a circle round him thrice, é nies i 
And close your eyes with holy dread, linkage (s ee p. bM92) of any oojects of contemp 
For he on honey-dew hath fed, lati on. 


And drunk the milk of Paradise. 


Xanadu is under private development and 
Should be available, if the economy holds, in 
1976. Regrettably, first prices will not be at 
the $3000 level necessary for the true Home 
System. Exact equipment for the production ver- 
sion has not been selected. A number of micro- 
processors (see p. 44 ) are in serious conten- 
tion, notably the Lockheed SUE, but there's 


"Is that the river that runs down to the sea?" 


James Stewart something to be said for a regular mini. The 
in PDP-11 is of interest (see p. 42 ); (so espe- 
"The FBI Story." cially is its Cal Data lookalike-- unless DEC 


would like to build us a PDP-11X with seven modes 
of indirect display addressing. Are you reading 
this, Ken Olsen?) And here's a laugh: a com- 
pany called IBM may in fact make a suitable conm- 
puter, except that they call it the "3740 Work 
‘ 15 Spiers Station." So for those customers who want IBM 
ss: . equipment, maintenance and prices, with Xanadu 


software, it's a definite possibility. 


So, fans, that about wraps it up. I'll be 
interested in hearing from people who want this 
system; many hardheaded business people have 
told me nobody will. Prove 'em wrong, America! 


a, Of course, if hyper-media aren't the great- 
Patent work on Xanadu is in progress. eSt thing since the printing press, this whole 
project falls flat on its face. But it is hard 
for me to conceive that they will not be. 


Yanady: 
BRASS VEX 


WHAT IT IS; the heart of the Xanadu system, now 
being debugged, consists of a highly integrated 
program for use on minicomputers ("software"-- 
see p. 36) or microprocessors ("firmware"-- see 
p- 44). It is an operating system with ‘two pro- 
grams: a highly generalized data management sys- 
tem for handling extremely complex data in huge 
files, and a generalized display system, married 
to the other, for handling branching animation 
and retrieval and canned display programs. These 
ordain retrievals by the data system. The Paral- 
lel Textface (see p.D)AS3) and the Walking Net 
(see p.3a5)) are two such canned programs. 


These internal systems are intended to be sold 
with consoles of various types, as illustrated 
nearby, for stand-alone turnkey use (see p. [3 ). 
Xanadu is self-networking: two on the phone make 
a network, and more can join. 


LANGUAGES: Xanadu programs will not be made avail- 
able in any higher languages, mainly because of their 
proprietary character, but also because the display 
routines (and some of the retrieval routines) must 

be programmed in machine language. 


The system has its own under-level language, XAP 
(Xanadu Assembly Program). While two higher-level 
display languages, DINGO (Display Lingo) and x¥lt 
(the ultimate?) are contemplated, these will not or- 
dinarily be accessible to the user. The purpose of 
Xanadu is to furnish the user with uncomputerish 
good-guy systems for specific purposes, not a chance 
to do his own programming. 


Important features of the data system are huge ad- 
dressability (in the trillions of elements) and Vir- 
tual Blocklessness. For advantages of this latter, 
see Zoom Map, p. DMI}- 


COMPATIBILITY: because of its highly compacted and 
unconventional structure, it is not compatible with 
other operating systems (including time-sharing) . 
Anyway, to put it on a larger machine is like hav- 
ing your Mazda driven around in a truck. Because 
it uses a line-drawing display (see p. DM?22-3) and 
therefore draws individual arbitrary lines on the 
screen repeatedly, it is not compatible with tele- 
vision either-- unless you point a TV camera at it, 
or the equivalent. Sorry. 


STANDARDIZATION. Taking a lesson from the integrated 
work of various people whose work has been described 
in this book, we see that if you want a thing done 
right, you have to do it yourself. (Great Ideas of 
Western Man: one of a series.) My good friend Calvin 
Mooers with his TRAC Language (see pp. 18-21) has dis- 
covered that trademark is one way to nail this as a 
right. 


Several levels of standardization are important with 
Xanadu. One, all Xanadu systems must be able to work 
with all Xanadu files (except for possible variations 
in screen performance and size of local memory). Now, 
there are those who would not be concerned for this 
sort of universality, and who might even try to make 
sure systems were incompatible, so that you had to buy 
accessories and conversion kits up and down the line. 
That is one of the things that must be avoided: "par- 
tial" compatibility, subject to expensive options and 
conditions, a well-known technique in the field. 


By stabilizing the "Xanadu" trademark, I hope to pre- 
vent such shenanigans. Thus every accredited Xanadu 
system will offer full compatibility with the data 
structure, and either full performance or substitutes 

as necessitated by the hardware. The "Xanadu" trademark 
can thus in principle be made available to manufacturers 
abiding by all design features of the system. 


be able to work with 
off the net, if they 


Second, all Xanadu systems should 
outside systems either through or 
conform to the unusual data rules required by the un- 
usual design of the system. This assures that Xanadu 
systems will be compatible with any other popular net- 
works. It also assures others who want to offer Xan- 
adu-class services to system owners (through, e.g., 
conventional time-sharing) that if they adhere to the 
rules (see “Canons,” p.p¥45%) they can play the game 
on a certified basis. 


AVAILABILITY. It is hoped that Xanadu will be avail- 
able in 1975 for at least one machine (guess which). 
As a program it will be available only in absolute 
form, without source or comments. 


AHEM. There is a lot to talk about, but a lot of time 
can be wasted talking. It is suggested that thought- 
ful computer firms, interested in some form of partici- 
pation, study this book carefully— at least enough so 
no one's time need be wasted. 
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A recent report by Arthur D. Little, a Boston firm 
that makes its money by seeming to be omniscient, 
commented on the considerable market potential 
for on-line data supply systems. The report 
cost $400 or $4000, I forget which. Big-time in- 
terests are aprowl. 
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(Mockup by Tom Barnard.) 


Porta-Xan. 
Faceplate reflects CRT to user while 
he's abroad in the world. One-hand 

typewrtting and pointing device frees 


the other. Can be butlt with avail- 
able ruggedized components. 


BASIC XANASY SUBSYSTEMS. 


Ke vaniach USN Sate \asic procyamns) : 
I Xenede eke (ne be renevel I. 


Kanedy feeder mackme. 


The Golden X's welcome 
the mind-hungry traveller. 


View from the snack balcony of a large Xanadu installation, 
overlooking the internal greenery. Hexagonal architecture 
permits physical expansion without interruption of services. 
(The mollusks have been telling us something about expansion.) 


THE AUTHOR ANSWERS THE QUESTIONS 
HE IS MOST FREQUENTLY ASKED. 


Q. If you publish your ideas like this, aren't 
you afraid someone will steal them? 
A. No. 


(The Law of Intellectual Property is about 
the strongest backing the individual has in 
this society.) 
Besides which, there is here no revelation of 
the Xanadu Sneakrets. 
Q. Won't some big company sweep your Xanadu 
under if they imitate it? 
Let ‘em. If they come up with a system having 
equivalent scope, which seems unlikely (see 
Canons, p.5M53), I might even feel I had 
achieved enough. But in the meantime, like 
the tortoise, and like DEC, I am going to 
continue to try to do it right. 
Aren‘t you afraid that writing a flippant book 
will keep people from taking you seriously? 
I do not want to be taken seriously in some 
quarters until it's too late. 


I have heard rumors that someone else in the field 
calls a computer product "Xanadu." 

I tend to doubt this; and even if they did, my 
usage goes back to 1966. 


I would like to thank (in chronological order) 
Elliot Klugman, Nat ("Kubla") Kuhn, Glenn 
Babecki, Cal Daniels and John V.E. Ridgway 
for the considerable time and involvement 
they gave to the Xanadu program design sesstons; 
thanks also to various others who sat in from. 
time to time, For the final selection of 
algorithms, however, no one is to blame but me. 


I am grateful to the good offices of Swarthmore 
College for the use of thetr equipment in the 
continuing efforts to debug the Xanadu programs. 


DAST 


%YAMAY) NETHORK 


First of all, bear in mind that Xanadu 1s a 
unified system for complex data management and 
display. This basically means that the same sy- 
stem (without the displays) can serve as a feeder 
machine for the data network itself. 


So far, so good. That means that we can have 
a minicomputer network handling the entire struc~ 
ture: sending out library materials to users on 
call, and storing any materials they want saved. 
This saves all kinds of hassles with big computers 
and big-computer-style programming. 


But who will pay for it? To build the kind 
of capacity we're talking about-- all those disks, 
all those minicomputers in a network-—- won't it 
take immense amounts of capital? How, people ask 
me, will any American company ever back such a 
Utopian scheme? 


Aha. 


One method of financing has proven itself in 
the postwar suburban era, this time of drive-ins 
and hamburger stands. 


Franchising. 

What I propose, then, is the Momeand Pop Xanadu 
Shop. Or, more properly, the Xanadu stand. "Mom and 
Pop" are the owners of the individual stand. But the 


customers can be families, too. 


From far away the children see the tall golden 
X's. "Oh, Daddy, can't we stop? I want to play 
Spacewar," says little Johnny. Big Sis adds, "You 
know, I have to check something for my paper on 
Roman politics." And Mom says, “Say, that would be a 
good place for lunch." 


So they turn in past the sign that says "OVER 
2 BILLION SCREEN HOURS," and pull into the lot. They 
park the car, and Dad shows the clerk his Xanadu cred- 
it card, and the kids run to screens. Dad and Mom 
wait for a big horizontal CRT, though, because there 
are some memories they'd like to share together... 


Sis's paper, of course, goes to her teacher 
through his Xanadu console. 
THE PLAN. IS IT AS CRAZY AS IT SEEMS? 
Deep inside, the public wants it, but people 


who think of computers in clichés can‘t comprehend 
it. This means “the public" must somehow create it. 


One way to go is to start a new corporation, 
register it with the SEC and try to raise a lot of 
money by selling stock publicly. Unfortunately 
there are all kinds of obstacles for that. (“Reg 
A" is about as far as it will go.) 


Through the-miracle of franchising, now, a lot 
of the difficulties of conventional backing can be 
bypassed. The franchisee has to put up the money 
for the computers, the scopes, the adorable purple 
enamel building, the johns and so on; as a Xanadu 
franchisee he gets the whole turnkey system and 
certain responsibilities in the OVERALL XANADU NET- 
WORK-- of which he is a member. He is assigned 
permanent storage of certain classes of materials, 
on call from elsewhere in the net. (Naturally, 
everything is stored in more than one place). 


The Xanadu subscriber, of course, gets what he 
requests at the screen as quickly as possible— or 
m priority if he wants to pay for it-- and may 
store his own files, including linkages among other 
naterials and marginal notations to other things 
that can be called. (See collateral structures, 
p-DM52; these can automatically bring forth any- 
thing they're linked to. (See "Nelson's Canons," 
p- \4S5$.)) A user's historical record will be 
stored to whatever degree he desires, but not (if 
he chooses) in ways that can be identified with 
hin. 


Home users need only dial a local phone num- 
ber-- their nearest Xanadu stand— to connect with 
the entire Xanadu network. (The cost of using 
something stored on the network has nothing to do 
with where it is stored.) 


(Special high-capacity lines need not be in- 
stalled between storage stations, as appropriate 
digital transmission services are becoming avail- 
able commercially.) 


Various security techniques prevent others 
from reading a subscriber's files, even if they 
sign on falsely; the Dartmouth technique of 
scrambling on non-stored keywords is a good one. 


The Xanadu stand also has private rooms with 
multiple screens, which can be rented for parties, 
business meetings, design sessions, briefings, 
legal consultations, lectures, seances, musicales, 
and so on. 


The choice locations for the Xanadu stands 
are somewhat different from hamburger spots. But 
that's probably not anything to go into here. 


Within the Xanadu network, then, people may 
read, write, send messages, study and play. 
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ANA DOODLES." 


fourfea, years oma eeyee 


ad you get a ifs: punchy. 


EVEL KNELSON — 
MiLt HE MAKE 177 


Thanks a lot, Sam Coleridge, 
for those two symbols. 


Xanadu. 
And the Albatross. 


“Listen,” Mr. Wonka said, “I’m an old man. ’'m much 
older than you think. I can’t go on forever. I’ve got no 
children of my own, no family at all. So who is going to 
run the factory when I get too old to do it myself? Someone’s 
got to keep it yoing—if only for the sake of the Oompa- 
Loompas. Mind you, there are thousands of clever men who 
would give anything for the chance to come in and take 
over from me, but! don’t want that sort of person. | don’t 
want a grown-up person at all. A grownup won’t listen 
to me; he won't Icarn. He will try to do things his own way 
and not mine. So I have to have a child. 1 want a good 
sensible loving child, one to whom I can tell all my most 
precious candy-making secrets —while I aim still alive.” 


Roald Dahl, Charlie and the Chocolate Factory, 
p.157. 


I am sorry I have not been able 
to reply to all those who have written 
to me saying they wish they could 
work for The Nelson Organization 
at even a low salary. 


So do I, my friends, so do I. 


[fp bed af he ietoos) Bet Gapibr Cuferesee, 193.1 


How are we going to sell the Home Computer? 


Well if you want to sell computers, let me tell you what to do: 
You've got to talk to the housewives, and the children, too; 
No one wants to program, they want something they can view... 


It's got to offer fun, and it's got to offer truth; 

It's got to give you something that'll lift you from the bo 
It's got to be uplifting to the Lady from Duluth. 

You've got to have a vision; you've got to have an angle; 
You should maybe sing a jingle (in a way that doesn't jangl 
It's got to have a tingle, in a way their minds can't tangl 


So continuing under our guidance inertial, 


Let's have the XANADU SINGING COMMERCIAL, 


a It's got everything to give. 
[arm ‘] It'll get you where you live. 
Realms of mind that you may roam: 
[ehemes] Grasp them all within your home. 

The greatest things you've ever seen 
(brass flourish | Dance your wishes on the screen. 
All the things that man has known 
[boss basta-t] Comin' on the telephone-- 
Poems, books and pictures too 
COMIN' ON THE XANADU 


[TUBULAR Beles 1) 


XAN-A-DU, 00-- 


THE-- WORLD-- OF-- youvuv/ 
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Is Xanadu worth waiting for? 


That depends, doesn't it, 
on the value of the hand-bush 
differential bird utility ratio. 
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WHAT NELSON 


1S REALLY SATING 
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end maybe some with, 


From "Barnum-Tronics" 
(citation p. DM 2.) 


1) Knowledge, understanding and 
freedom can all be advanced by the 
promotion and deployment of com- 
puter display consoles (with the 


right programs behind them). 

2) Computer presentational media, 
coming soon, will not be technically 
determined but rather will be new 
realms for human artistry. This point 
of view radically affects how we 
design man-machine systems of any 
kind, especially those for informa- 
tion retrieval, teaching, and general 
writing and reading. Some practi- 
tioners see such systems as narrowly 
technical, with the computer hoisting 
up little pieces of writing on some 
“scientific” basis and showing them 
to you one grunt at a time. A Metre- 
cal banquet. I disagree. The systems 
should be opulent. 

3) The problem in presentational 
systems of any kind is to make 
things look good, feel right, and come 
across clearly. The things that mat- 
ter are the feel of the system, the 
user’s state of mind, his possible con- 
fusion, boredom or enthusiasm, the 
problems of communicating concepts, 
and the very nature of concepts and 
their interconnection. There will 
never be a “science” of presentation, 
except as it relates to these things. 

4) Not the nature of machines, 
but the nature of ideas, is what 

’ matters. It is incredibly hard to de- 
velop, organize and transmit ideas, 
and it always will be. But at least 


It is time to start using computers 
to hold information for the mind 
much as books have held this infor- 
mation in the past. Now information 
for the mind is very different from 
“information for the computer” as 
we have thought of it, hacked up 
and compressed into blocks. Instead 
we can stretch the computer. 

I am proposing a curious kind of 
subversion. “Let us design,” I say; 
and when people see the systems, 
everybody will want one. All I want 
to do is put Renaissance humanism 
in a multidimensional responsive con- 
sole. And I am trying to work out 
the forms of writing of the future. 
Hypertexts. 

Hypertexts: new forms of writing, 
appearing on computer screens, that 
will branch or perform at the reader’s 
command. A hypertext is a non- 
sequential piece of writing; only the 
computer display makes it practical. 
Somewhere between a book, a TV 
show and a penny arcade, the hyper- 
text can be a vast tapestry of infor- 
mation, all in plain English (spiced 
with a few magic tricks on the 
screen), which the reader may attack 
and play for the things he wants, 
branching and jumping on the screen, 
using simple controls as if he were 


- driving a car. There can be special- 


ized subparts for specialized in- 
terests, instant .availability of rele- 
vancies in all directions, footnotes 
that are books themselves. Hyper- 
texts will be so much better than 
ordinary writing that the printed 
word will wither away. Real writing 
by people, make no mistake, not 


data banks, robot summaries or other 
clank. A person is writing to other 
people, just as before, but on magical 
_paper he can cut up and tie in knots 
and fly around on. 


in the future we won’t be booby- 
trapped by the nature of paper. We 
can design magic paper. 


I believe in calling a spade a spade 
-- not a personalized earth-moving equip- 
ment module; and a multi-dimensional spade, 
by gum, a hyperspade-- not a personalized 
earth-moving equipment module with augmen- 
ted dirt access, retrieval and display cap- 
ability under individulaized control. 


I want a world where we can read the world’s literature from screens rather 
than personally searching out the physical books. A world without routine vaper- 
work, because all copying operations take place automatically and formalized tran- 
sactions occur through formalized ceremonies at consoles. A world where ve can 
learn, study, create, and share our creations without having privately to schlepp and 
physically safeguard them. There is a familiar, all-embracing motto, the jingle we 
all know from the day school lets out, which I take quite seriously: "No more pencils; 
no more books; no more teachers’ dirty looks.” The Fantic Age. 


From "Computopia and Cybercrud." 
(Citation nearby.) 


NINFESTO 


My work is concerned principally with the 
theory and execution of systems useful to the mind 
and the creative imagination. This has polemical 
and practical aspects: I claim that the precepts of 
designing systems that touch people's minds, or 
contents to be shown in them, are simple and uni- 
versal: making things look good, feel right and 
come across clearly. I claim that to design systems 
that involve both machines and people's minds is 
art first, technology second, and in no way a deri- 
vative specialty off in some branch of computer 
science. 


However, presentational systems will cer- 
tainly involve computers from now on. 


Since hundreds of such systems are now 
being built, many of them all wrong, we must 
teach designers (and certain others) the basics 
of computers, and give them some good examples 
to emulate (such as Sutherland's Sketchpad, 
Bitzer's PLATO, and, I hope, some of my own 
designs). 


Further, the popular superstitions about 
computers must be fought-- the myths that they 
are mechanistic, scientific, objective or indepen- 
dent of human intent and contemplative involve- 
ment. 


ELSON'S CANONS 
A Bell f Trformst-on Rights 


It is essential to state these firmly and 
publicly, because you are going to see a lot 
of systems in the near future that purport to 
be the last-word cat's-pajama systems to bring 
you "all the information you need, anytime, 
anywhere." Unless you have thought about it 
you may be snowed by systems which are in- 
herently and deeply limiting. Here are some 
of the things which I think we will all want. 
(The salesman for the other system will say 
they are impossible, or "We don't know how 
to do that yet," the standard putdown. But 
these things are possible, if we design them 
in from the bottom up; and there are many 
different valid approaches which could bring 
these things into being. 


These are rules, derived from common 
sense and uncommon concern, about what people 
ean and should have in general screen systems, 
systems to read from. 


4; EASY AND ARBITRARY FRONT ENDS. 


The "front end" of a system-- that is, 
the program that creates the presentations for 
the user and interacts with him-- must be clear 
and simple for people to use and understand. 


THE TEN-MINUTE RULE. Any system 
which cannot be well taught to a layman in 
ten minutes, by a tutor in the presence of a 
responding setup, is too complicated. This may 
sound far too stringent; I think not. Rich and 
powerful systems may be given front ends which 
are nonetheless ridiculously clear; this is a 
design problem of the foremost importance. 


TEXT MUST MOVE, that is, slide on the 
screen when the user steps forward or backward 
within the text he is reading. The alternative, 
to clear the screen and lay out a new presenta- 
tion, is baffling to the eye and thoroughly dis- 
orienting, even with practice. 


Many computer people do not yet under- 
stand the necessity of this. The problem is that 
if the screen is cleared, and something new 
then appears on it, there is no visual way to 
tell where the new thing came from: Sequence 
and structure become baffling. Having it slide 
on the screen allows you to understand where 
you've been and where you're going; a feeling 
you also get from turning pages of a book. 
(Some close substitutes may be possible on 
some types of screen.) 


On front ends supplied for normal users, 
there must be no explicit computer languages 
requiring input control strings, no visible eso- 
teric symbols. Graphical control structures 
having clarity and safety, or very clear task- 
oriented keyboards, are among the prime alter- 
natives. 


All operations must be fail-safe. 


Arbitrary front ends must be attachable: 
since we are talking about reading from text, 
or text-and-picture complexes, stored on a 
large data system, the presentational front end 
must be separable from the data services pro- 
vided further down in the system, so the user 
may attach his own front-end system, having 
his own style of operation and his own private 
conveniences for roving, editing and other forms 
of work or play at the screen. 


2. SMOOTH AND RAPID DATA ACCESS. 


The system must be built to make possible 
fast and arbitrary access to a potentially huge 
data base, allowing extremely large files (at 
least into the billions of characters). However, 
the system should be contrived to allow you to 
read forward, back or across links without sub- 
stantial hesitation. Such access must be impli- 
cit, not requiring knowledge of where things are 
physically stored or what the internal file names 
may ,happen to be. File divisions must be in- 
visible to the user in all his roving operations 
(FREEDOM OF ROVING): boundaries must be 
invisible in the final presentations, and the user 
must not need to know about them. 


3. RICH DATA FACILITIES. 


Arbitrary linkages must be possible be- 
tween portions of text, or text and pictures; 
annotation of euything must be provided for; 
collateration (see p.*So) should be a standard 
facility, between any pair of well-defined ob- 
jects; PLACEMARK facilities must be allowed 
to drop anchor at, or in, anything. These 
features imply private annotations to publicly- 
accessible materials as a standard automatic 
service mode. 


The AI people don't understand, 


the IR people don't understand, 
the CAI people don't understand, | 
and for God's sake don't tell IBM. 


I believe that an introduction to any 
subject can be humorous, occasionally pro- 
found, exciting, vivid, and appealing even 
to experts on their -separate levels. 


Perhaps someday I can prove it. 


4 


4. RICH DATA SERVICES BASED ON 
THESE STRUCTURES. 


The user must be allowed multiple rovers 
(movable placemarks at points of current activity); 
making possible, especially, multiple windows 
(to the location of each rover) with displays of 
collateral links. 


The system should also have provision 
for high-level mooting ( and the auto- 
matic keeping of historical trails. 


Then, a complex of certain very necessary 
and very powerful facilities based on these things, 
viz.: 

A. ANTHOLOGICAL FREEDOM: the user must 
be able to combine easily anything he finds into 
an "anthology," a rovable collection of these 
materials having the structure he wants. The 
linkage information for such anthologies must be 
separately transportable and passable between 
users. 

B. STEP-OUT WINDOWING: from a place 
in such an anthology, the user must be able 
to step out of the anthology and into the previous 
context of the material. For instance, if he has 
just read a quotation, he should be able to have 
the present anthological context dissolve around 
the quotation (while it stays on the screen), and 
the original context reappear around it. The 
need of this in scholarship should be obvious. 

C. DISANTHOLOGICAL FREEDOM: the 
user must be able to step out of an. anthology 
in such a way and not return if he chooses. 
(This has important implications for what must 
really be happening in the file structure.) 


Earlier versions of public documents must 
be retained, as users will have linked to them. 


However, where possible, linkages must 
also be able to survive revisions of one or both 
objects. 


5. "FREEDOM FROM 
SPYING AND SABOTAGE." 


The assumption must be made at the 
outset of a wicked and malevolent governmental 
authority. If such a situation does not develop, 
well and good; if it does, the system will have 
a few minimal safeguards built in. 


FREEDOM FROM BEING MONITORED. The 
use of pseudonyms and dummy accounts by indi- 
viduals, as well as the omission of certain record- 
keeping by the system program, are necessary 
here. File retention under dummy accounts is 
also required. 


Because of the danger of file sabotage, and 
the private at-home retention by individuals of 
files that also exist on public systems, it is 
necessary to have FIDUCIAL SYSTEMS FOR TELLING 
WHICH VERSION IS AUTHENTIC. The doctoring 
of on-line documents, the rewriting of history-- 
cf. both Winston Smith's continuous revision of 
the encyclopedia in Nineteen Eighty-Four and 
H.L. Hunt's forging of historical telegrams for 
"The White House"-- is a constant danger. Thus 
our systems must have a number of complex 
provisions for verification of falsification, espe- 
cially the creation of multilevel fiducials (parity 
systems), and their storage in a variety of 
places. These fiducials must be localizable and 
separate to small parts of files. 


7. COPYRIGHT. 


Copyright must of course be retained, but 
a universal flexible rule has to be worked out, 
permitting material to be transmitted and copied 
under specific circumstances for the payment of 
a royalty fee, surcharged on top of your other 
expenses in using the system. 


For any individual section of material, 
such royalty should have a maximum: i.e., "by 
now you've bought it." 


Varying royalty rates, however, should 
be the arbitrary choice of the copyright holder; 
except that royalties should not vary sharply 
locally within a tissue of material. On public 
screens, moving between areas of different roy- 
alty cost must be sharply marked. 
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- EPOOL 


I have had a most rare vision. I have had a 
dream, past the wit of man to say what dream 
it was: man is but an ass, if he go about to ex- 
pound this dream. . Methought I was—there is 
no man can tell what. Methought I was,—and 
methought I had—but man is but a patched 
fool, if he will offer to say what methought I had. 


The eye of man hath not heard, the ear of man 
hath not seen, man’s hand is not able to taste, 
his tongue to conccive, nor his heart to report, 
what my dream was. = 


Bottom the Weaver 


Now you see why I brought you here. 
This Gem-maniacal book has, obviously, been 
created as a crossroad of several cross pur- 
poses: to furnish a needed, grabby layman's 
introduction to two vast but rather inaccessible 
realms; to present a coherent, if contentious, 
point of view, and unroll a particular sort of 
apocalyptic vision after preparing the vocabulary 
for it; to make bright friends and informed sup- 
porters for my outlook and projects; to get home 
to some of my friends the fact that what I am 
doing is at bottom not technical; and finally, if 
nothing else, to set forth some principles about 
the’ way things should be, which others will 
have:to answer if they propose to do less. 
Thus, overall, this book is a message in a Klein 
bottle, waiting to see who's thirsty. 


I suppose it all started in college. Swarth- 
more left me with an exaggerated notion of the 
extent to which ideas are valued in the academic 
world; it took two graduate schools to clear this 
up. After that, as far as I was concerned, 
Ph.D. stood for Poophead. But I still cared 
about ideas, and the deep necessity of finding 
their true structure and organization. From 
writing I knew the grueling difficulty of trying 
to make ideas get in order. I believed in the 
pure, white light of inspiration and the power of 
the naive but clever mind to figure out anything, 
if not obstructed but dumb dogmas and obtuse 
mental schemata fostered by the educational system. 


When I finally got the idea of what compu- 
ters were about, sometime in 1960, I took endless 
walks at night trying to hash these things out and 
see where they led. The text systems came clear 
to me, at least in their beginnings; in a few weeks; 
the realization that 3D halftone was possible came 
to me as a shock the following spring, I believe 
as I was walking across Radcliffe Common. Since 
then trying to build these systems for creation and 
the true ordering of intricate thought has been my 
driving dream. 


My own life among these dream machines 
has been a nightmare, thoroughly unpleasant, 
and if people are right in telling me that nobody 
wants systems like the ones I am designing, 

I'll get the heck out of this and be a disk jockey 
or a toy salesman or something. 


I first got into this as a writer; all I 
wanted was a decent writing system that would 
run on a computer. Little did I realize the im- 
mensity of what that entailed, or that for some 
reason my work and approach would engender 
indignation and anger wherever I went. There 
is a fiction that everybody in these fields is 
doing something fundamentally scientific and 
technical, and this fiction is usually upheld in 
carefully enacted mutual playlets. Trying to 
cut through that and say, "Let's build a home for 
mankind that will at last be shaped to fit man's 
mind," does not seem to- generate immediate 
warmth and welcome. 


But I'm glad for the friends I've made in 
this field, and of course there have been a lot 
of laughs. (I'd really have hated to miss being 
in this field, just for the thrilling madness of 
it all.) All in all my adventures have been a 
sort of participatory journalism, which I'd like 
to write up properly some time. Some highlights: 


The days of madness in '68, trying to 
start an honest corporation to do all this stuff, 
and suffering endless lunches with Wall Street 
hangers-on who were looking for a vehicle to 
take public. They wanted another chicken- 
franchise type company, though, and certainly 
not ideas. 


Being briefed by four different corporations, 
most of them major, on the fantastic powers their 
interactive-movie system was going to have. One 
of these briefings was in the board room of a 
famous skyscraper. And now, only one of those 
systems is left-- Kodak's. 


Then there was the courtly gentleman who 
was going to be my Noah Dietrich, my Colonel 
Parker. He assured me that through his business 
connections all was going to go marvelously, 
and then later intimated that as a special favor 
he was going to put me in touch with other 
universes and the flying saucer people. I just 
didn't have time for other universes. 


Then there was the suppression of my first 
book (this is my second). You might say it was 
a misunderstanding, at least on my part. My 
boss's understanding was evidently that the ad- 
vancement of my ideas would be detrimental to 
his. If it had been a question of free speech in 
Yugoslavia it might have been different. Well, 
it takes a long time to get a book together, but 
here we go again. 


Then there was the time I was called in 
as a consultant on a vast federal system, never 
mind what. Numerous computer programs were 
to be coordinated by a hypertext system they 
had created and they wanted to know if they'd 
designed it right. It took months to find out 
from the programmers exactly what the system 
was, so I ended up writing the manual; after 
which I explained what was wrong with the pro- 
ject and the whole hypertext system was scrapped. 
And my job with it. I never quite got the swing 
of consulting. 


Flying coast-to-coast with the president 
of a large corporation, he and I planned the 
whole Xanadu budget for the following year at 
something like half a million dollars. Two years 
later, reduced in circumstances and driving a 
yellow cab in New York, the miserable vehicle 
breaks down in front of those same corporate 
headquarters. And the reason I had that bad 
taxi was that I was out of favor with the taxi 
dispatcher, on account of having been absent 
the previous week-- I had had to fly to California 


to give a banquet address at the Rand Corporation. 


Then there were my adventures with the 
CIA. 


I was sitting in my office at voasar, 
sagely advising a student, when the phone rang 
and the caller identified himself as John W. 
Kuipers, head of computer research at the CIA. 
He told me I had been noticed as a new bright 
young man in the field, and would I like to 
work for them? 


Now, there is something about being a 
cynic and a romantic. (They go together: the 
cynic deflates ideas, the romantic falls in love 
with them.) It is not impossible for the cynical 
romantic to surmise that because everything he 
has seen personally turned out to be so lousy, 
that the true hope may lie at the heart of the 
vortex, just where everybody thinks is impossible. 
Also the Kennedy aftermath, when sophisticated 
people had learned to laugh at simple idealism 
as a facade for the real wheel-and-dealing, 
slap-and-tickle, may have had something to do 
with it; anyway, I was enchanted. Thus began 
the Kuipers Caper. 


YES, THERE IS A McLEAN, VIRGINIA 


I was given a handler named Bob, a jolly 
fellow, who kept assuring me that much money 
was just around the corner. I was regaled with 
success stories of other people in the computer 
field who really, undercover Worked for Them. 
(They weren't doing anything very exciting.) 

I got to show my slides in the CIA office building 
in Arlington, and to see there very fancy display 
equipment behind shielded (!) double-doors in 

a shielded (!!) computer room-- shielded to keep 
any planted bugs from transmitting out the con- 
tents of the computers' working registers. I even 
got to visit the main CIA "campus" in McLean, 
Virginia, where the sign says Agricultural 
Research Station. It is an incredible feeling to 
walk across that big eagle in the terrazzo, 

and to be given the visitor's badge that says 
"United States Government" all in wiggly lines. 


They told me that they would be glad to 
set me up in business as a hypertext company, 
but I would have to have a corporation, because 
that was the way they always did things. And so. 
it came to pass that The Nelson Organization, Inc. 
was founded at the express request of the United 
States Central Intelligence Agency. I wouldn't have 
had it any other way. If life can't be pleasant it 
can at least be surrealistic. 


. BUT NO SANTA CLAUS 


I was encouraged to write proposals for them, 
and write proposals I did. (I happened to finish 
typing the first one dufing a lightning storm, 
and lightning crashed just as I was signing the 
page; I felt like Faust.) I explained how hyper- 
text might have prevented the Bay of Pigs. After 
due consideration, I did not say what hypertexts 
might have done for the Warren Report. Numerous 
jolly phone calls assured me that my first $25,000 
was just around the corner. 


The break came when Bob called me and 
asked me to rewrite a proposal one more time. 
He had circulated it, he said, among various 
people "at the shop," who he reminded me were 
holders of advanced degrees, and it had been 
remarked that they found my proposal meaning- 
less: "Every place you say ‘hypertext’ you 
could just as well put 'gobbledygook' instead; 
you'll have to clear that up a little." 


IMS 


That did it. They couldn't read either. 
Who turns out to be in charge of computer stuff 
in the heart of the CIA, the inner sanctum, the 
nest of vipers, but the same old poopy Ph.Ds. 
I decided to resuscitate my virtue. 


As far as I know, there is still not a 
Decent Writing System anywhere in the world, 
although several things now come close. It 
seems a shame that grown men and women have 
to rustle around in piles of paper, like squirrels 
looking for acorns, in search of the phrases 
and ideas they themselves have generated. 

The decent writing system, as I see it, will 
actually be much more: it will help us create 
better things in a fraction of the time, but also 
keep track of everything in better and more 
subtle ways than we ever could before. 

But nobody sees this-- I suppose it's only 
writers and editors that know they're trying to 
"keep track of ideas"-- and I have been unable 
to get this across to anybody. (The professional 
writers, of course, won't talk to me either.) 


So here I am after fourteen years with 
exactly two systems to show for it: the main one, 
Xanadu, the text-and-animated-picture network 
system, and Fantasm (I shouldn't have spent 
the time but it was a labor of love), the simu- 
lated-photography system. Actually, I don't 
have either of them to show, it's all just flow- 
charts, but it turns out that if I work on either 
of them with university equipment, my work of 
fourteen years gets confiscated. So much for 
that; the outside expedients for debugging con- 
tinue. 


And, to lighten the burden, I've finally 
given up on trying to reach professionals, who 
evidently need a thick gravy of technicalism to 
make the obvious palatable; with this bookity 
I am taking my case to The People. It is there, 
anyway, out in Consumerdom, that the real ac- 
tion is going to occur. So the important thing 
is for everybody to know what's really possible, 
and what they could have. That is why I have 
shot off my big canons (and this epistol). 


To me, you see, this is really a holy 
crusade, whereas I know guys to whom it's 
just a living. It's no less than a question 
of freedom in our time. The cases of Solzhenitsyn 
and Ellsberg remind us that freedom is still 
not what it should be, anywhere. Computer 
display and storage can bring us a whole new 
literature, the uniting and the apotheosis of the 
old and the new; but there are many who would 
not necessarily want to see this come about. 
Deep and widespread computer systems would be 
tempting to two dangerous parties, "organized , 
crime" and the Executive branch of the Federal 
government (assuming there is still a difference 
between the two). If we are to have the freedoms 
of information we deserve as a free people, the 
safeguards have to be built in at the bottom, now. 
And the opulence which is possible must be made 
clear to everyone before we settle on an inferior 
system-- aS we did with television. 


Some people have called my ideas and 
systems "Orwellian." This is annoying in two 
ways. In the first place it suggests the night- 
mare of Orwell's book Nineteen Eighty-Four, 
which obviously I want no part of. (But hey, 
do you remember what that world of 1984 was 
actually like? The cryptic wars against unseen 
enemies that kept shifting? The government 
spying? The use of language to twist and 
manipulate? To paraphrase Huey Long: "Of 
course we'll have 1984 in America. Only we'll 
call it 1972.") 


The second reason the term "Orwellian" 
is offensive is that it somehow reduces the life 
of Orwell, the man, to the world of "1984." 
This is a shallow and shabby thing to do to a 
man who spent his life unmasking oppressiveness 
in human institutions everywhere. 


In the larger sense, then-- in homage to 
that simple, honest, angry man, who cared about 
nothing more than human freedom-- I would be 
proud indeed if my systems could be called 
Orwellian. 


That reminds me. Nowhere in the book 
have I defined the phrase "computer lib." By 
Computer Lib I mean simply: making people 
freer through computers. That's all. 


Fantically-- or fanatically-- 
Yours for a better world, 
Before we have to settle for Any-- 


Yo Neb, 


OZ 


